About DeepLight:
DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI research and development.
We are seeking an experienced AWS Data Engineer with solid knowledge in DBT (Data Build Tool), AWS Data Migration Service (DMS), AWS DataSync, and AWS Fargate. The ideal candidate will play a key role in managing and optimizing data workflows, migration strategies, and serverless data processing on AWS.
Key Responsibilities:
Utilize DBT to build and maintain data transformation pipelines.
Manage data migration projects using AWS DMS, ensuring smooth and efficient transfers.
Implement data synchronization workflows using AWS DataSync for on-premises and cloud data movement.
Leverage AWS Fargate for serverless computing and containerized workloads.
Design and implement data workflows to ensure scalability and performance optimization.
Monitor and maintain data pipelines and ETL processes.
Collaborate with other teams to understand data requirements and deliver high-quality data solutions.
Strong experience with DBT and creating data transformation workflows.
Expertise in AWS Data Migration Service (DMS) and AWS DataSync.
Experience working with AWS Fargate for serverless container management.
Solid understanding of AWS ecosystem and services related to data engineering.
Strong analytical skills and the ability to troubleshoot complex data issues.
Excellent communication skills for working with both technical and non-technical teams.
Preferred Skills:
Knowledge of container orchestration tools like Kubernetes.
Familiarity with SQL and cloud data architectures.