The hiring company is seeking a skilled and experienced Big Data Platform Developer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining the big data platform. This role involves working closely with cross-functional teams to ensure the smooth operation and optimization of the data infrastructureabout the job.
- Design, develop, and implement scalable and reliable big data solutions.
- Collaborate with data scientists, analysts, and engineers to understand data requirements and implement appropriate solutions.
- Develop and maintain ETL processes to ingest, process, and store large volumes of data.
- Optimize and tune existing data pipelines and algorithms for improved performance.
- Implement security measures to protect data integrity and privacy.
- Troubleshoot and resolve data platform issues in a timely manner.
- Stay updated on emerging technologies and trends in big data and analytics.
skills & experiences required.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven work experience as a Big Data Developer or similar role.
- Strong programming skills in languages such as Java, Python, or Scala.
- With 8 years of experience in IT and at least 3 years of experience in leading the solution implementation of high-volume heterogeneous data, preferably with distributed systems such as EMR, Big Query, and Hadoop.
- Hands-on experience in implementing and managing CICD pipelines for Big Data applications using tools like Jenkins, GitLab CI/CD, etc.
Proficiency in infrastructure provisioning and configuration management using tools like Terraform, Ansible, or AWS CloudFormation.Experience working with big data technologies such as Hadoop, Spark, Kafka, Hive, etc. - Proficiency in SQL and NoSQL databases.
- Familiarity with data warehousing concepts and cloud platforms, preferrably in AWS.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Knowledge of machine learning and data mining techniques.
- Previous experience in developing real-time data processing systems.
show more
about the company.
The hiring company is seeking a skilled and experienced Big Data Platform Developer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining the big data platform. This role involves working closely with cross-functional teams to ensure the smooth operation and optimization of the data infrastructure
about the job.
- Design, develop, and implement scalable and reliable big data solutions.
- Collaborate with data scientists, analysts, and engineers to understand data requirements and implement appropriate solutions.
- Develop and maintain ETL processes to ingest, process, and store large volumes of data.
- Optimize and tune existing data pipelines and algorithms for improved performance.
- Implement security measures to protect data integrity and privacy.
- Troubleshoot and resolve data platform issues in a timely manner.
- Stay updated on emerging technologies and trends in big data and analytics.
skills & experiences required.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven work experience as a Big Data Developer or similar role.
- Strong programming skills in languages such as Java, Python, or Scala.
- With 8 years of experience in IT and at least 3 years of experience in leading the solution implementation of high-volume heterogeneous data, preferably with distributed systems such as EMR, Big Query, and Hadoop.
- Hands-on experience in implementing and managing CICD pipelines for Big Data applications using tools like Jenkins, GitLab CI/CD, etc.
...
Proficiency in infrastructure provisioning and configuration management using tools like Terraform, Ansible, or AWS CloudFormation.Experience working with big data technologies such as Hadoop, Spark, Kafka, Hive, etc.
Proficiency in SQL and NoSQL databases.Familiarity with data warehousing concepts and cloud platforms, preferrably in AWS.Excellent problem-solving and analytical skills.Strong communication and collaboration abilities.Knowledge of machine learning and data mining techniques.Previous experience in developing real-time data processing systems.show more