Data Engineer

  • Location

    United States of America

  • Sector:

    Database & Data Engineers

  • Job type:

    Permanent

  • Contact:

    Tyler King

  • Contact email:

    tyler.king@adaptiveengineering.io

  • Published:

    4 months ago

  • Expiry date:

    2022-10-30

Job Description:

  • Participate actively in the architecture design of the Global Data Estate

  • Create scalable automation scripts to provide a flexible framework that aids in automating data processing. Develop, customise, deploy, and administer our Data Lake House environment.

  • Testing and quality assurance of fresh updates and improvements produced by the team

  • Keep an eye on and maintain the data solutions' general performance and stability.

  • solve difficult problems and commercial difficulties with less supervision

  • Keep data quality up to date, make sure compliance criteria (such as data privacy) are fulfilled, and maintain data estate.

  • aid in the creation and design of reports that the rest of the organisation will read.

  • When necessary, mentor and train co-workers to help them develop new abilities, exchange best practises, and learn from each other.

Job Qualifications:

  • Bachelor's degree from a four-year institution and four years of relevant work experience

  • a solid understanding of SQL and expertise with Python or other related languages for data engineering

  • Outstanding knowledge in dimensional data modelling and schema design for Enterprise Data Warehouses and/or Data Lake systems, with expertise in the ELT/ETL cycle and in the creation and maintenance of large-scale, low-latency data-marts

  • a strong understanding of big data technologies such as Synapse Analytics, Azure Databricks, ADLS Gen 2, and Microsoft Azure (especially in Azure)

  • A plus is having knowledge of the PowerBI data visualisation tools (PowerBI)

  • Working knowledge of Parquet, JSON, and XML formats, as well as using APIs to push and pull data from different data sources

  • Excellent analytical and problem-solving abilities and a good attention to detail.

Superior health, dental, and vision benefits

  • 401(k) with annual corporate match

  • Transportation compensation

  • Paid education Paid time off

  • Paid vacations

  • Prizes for travel and cruising

  • Discounted tickets for movies, theme parks, and theatres

  • Wellness programme for employees

  • Joining a GYM