Senior Data Engineer

About the Senior Data Engineer position

We are looking for a Data Engineer who will be responsible for developing, testing, improving and maintaining new and existing databases to help users retrieve data effectively. You will have to ensure our database systems run effectively and securely on a daily basis.

You should be apt for productive collaboration with the development team, as well as administrators and clients, to ensure system consistency, provide technical support and identify new requirements. You should also be organized and communicative.

Responsibilities :

• Create and support stable, reliable and effective databases
• Update databases according to requests and perform tests
• Troubleshoot database usage issues and malfunctions
• Get user requirements and identify new features
• Collaborate with developers to improve applications and establish best practices
• Optimize and maintain legacy systems
• Create technical and training manuals and support users
• Explore new database products, services and protocols and make suggestions of their usage
• Ensure all database programs meet company and performance requirements

Requirements :

• 8+ years of experience working on a Data Engineer position
• Sound knowledge in data structures
• Working knowledge in one T-SQL
• Ability to work using Linux Commands Line
• Must have : Any programming language (Scala/Python/Java), Apache Spark, any RDBMS, any No-SQL db
• Good to have : Apache NiFi, AWS Athena, S3, Glue, knowledge of any cloud service (AWS/Azure/GCP), any Stream/Queues sourced such as Apache KAFKA or RMQ (RabbitMQ), Knowledge of hadoop, hive