Location: Chennai, India
C1X Inc. is a fast-growing, global technology company headquartered in San Jose, US, and with offices in Chennai and Bangalore. Our mission is to simplify and innovate digital marketing by building unique and large scale data products. We are a world-class engineering team that encompasses front end (UI), back end (API / Java), mobile (Android/IOS), and Big Data engineering to deliver compelling products.
You will be a key member of the data engineering team, responsible for shaping and delivering data products. You’ll have the opportunity to shape the next generation of data analytics tech stack leveraging big data technologies. You will be working closely with business stakeholders, product managers, and engineering teams to meet the data requirements of various initiatives.
Responsibilities
- Build large-scale batch and real-time data pipelines with data processing frameworks like Spark on AWS.
- Manage data flows and set up automation between various data sources.
- Implement best practices in continuous integration and deliver data quality. Maintain data documentation and definitions.
- Help drive optimization, testing, and tooling of the data products.
Qualification
- B.E. in Computer Science/Engineering or equivalent.
- Strong demonstrable skills in two of the following programming languages – Python or Scala.
- Minimum 2 years experience working on full life cycle Big Data production projects
- Should have experience with AWS services like EMR, Lambda, S3, DynamoDb.
- Strong Experience in processing Big Data and analyzing the data using Spark, Map Reduce, Hadoop, Sqoop, Apache Airflow, HDFS, Hive, Zookeeper.
- Familiar with Docker, Airflow, or equivalent data pipeline and workflow management tool.
- Intermediate to advanced knowledge of SQL. Relational SQL and NoSQL databases, including Postgres, MySql, Redshift, and Redis. Experience in SQL tuning, schema design, or analytical programming.
- Experience with different storage formats like Parquet, Avro, Arrow, and JSON.
- Experience in unit, functional and automated testing.
- Strong expertise in troubleshooting production issues.
- Comfortable working across a wide array of technologies, fast-paced, and results-oriented environment.
- Excellent verbal and writing skills to effectively collaborate with both business and technical teams.