As a Senior Data Engineer, you will play a crucial role in designing, building, and maintaining data pipelines and integrations that power our data-driven decision-making processes and optimize processes. You will play an important role in jointly building and developing the internal data team and work closely with cross-functional teams to ensure data availability, accuracy, and accessibility while staying up to date with the latest technology trends in the field. Therefore, you must also be a good communicator with regular exposure to various office departments and crew on board the vessels.
Responsibilities:
- Design, develop, and maintain data pipelines to collect, process, and distribute data efficiently.
- Collaborate with data analysts, and other stakeholders to understand data requirements and ensure smooth data flow between systems and applications.
- Build and maintain integrations with third-party data sources and services.
- Optimize data infrastructure for performance, scalability, and reliability.
- Stay current with the latest data engineering and integration technologies and incorporate them into our systems.
- Troubleshoot and resolve data-related issues as they arise.
Knowledge & Skills:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer, with a focus on building integrations.
- Strong expertise in data integration tools, techniques, and cloud platforms (Azure)
- Experience with Azure Fabric and related items such as Onelake, Azure Data Factory, and Azure DevOps.
- Proficiency in programming languages like Python, SQL, and Spark.
- Experience with data warehousing, ETL (Extract, Transform, Load) processes, and data modeling.
- Excellent problem-solving and communication skills.
- Ability to work effectively in a collaborative team environment.
- Knowledge of real-time data processing and streaming technologies.
- Knowledge of Agile development.