ASTRAPIA CONSULTING LLP
About the Role
The Data Engineer plays a critical role within the IT function. The candidate must be experienced but still have a passion for learning, mentoring, and collaboration. Our teams will be small, but experienced and this role will sit at the epicenter of building and managing a data warehouse, supporting custom applications, and developing best practices around implementing data pipelines. We are looking for an outstanding Data Engineer who is data-driven, uncompromisingly detail oriented,smart, efficient, and driven to help our business succeed.
Requirements
Interact with Management to determine the organization’s data needs, and translate them into systems design and data pipelines.
Act as a technical change agent within the Data & Analytics team by advocating best practices.
Responsible for supporting the design and development of data warehouse and reporting-based solutions in a SaaS product.
Convert business requirements into technical solutions working with the data analytics team to implement.
Implementing the migration of data from legacy systems to new solutions.
Examine and identify database structural necessities by evaluating performance, systems monitoring, and environment applications
Contribute to the technical team to assist in delivering a flexible and scalable solution.
Provide oversight and mentorship to other team members.
Security and data integrity in a HIPAA, PII Compliant systems
Minimum Qualifications & Competencies
Batchelors or Masters in Computer Science, Information Technology or related field
4+ years of industry experience Data Engineering, BI Engineer, or related field with a track record of manipulating, processing, and extracting value from large datasets
Hands on experience and advanced knowledge Matillion ETL tool, SQL, Python, Databricks and Azure Cloud services like Azure Data factory.
SQL query optimization techniques, data modeling techniques, and relational database design
Strong experience in Data modeling, ETL/ELT Development, and Data Warehousing
Various database development technologies, such as Snowflake, SQL Server, Azure SQL Database, Azure Data Warehouse, including ETL tools, and OLTP/OLAP.
Understanding of data modeling, data lakes, data-driven insight, data quality, and governance
Experience in hands-on design, prototyping, development, configurations, testing and other implementation activities
Strong technical background, analytical and problem-solving skills are required
Experience with reporting tools (Power – Bi, Tableau a plus)
Ability to work collaboratively within a team environment and capable of delivering under aggressive timelines
Looking for self-motivated candidates who are hands-on at their current positions and have a hunger to learn new technologies
Able to work in a fast-paced, dynamic environment
Capable of incident resolution during a major incident process
Good time management and prioritization skills; self-starters especially welcome
Maturity and ability to take responsibility for gathering additional information on requirements and design to effectively establish testing for the applications and processes
Dedicated to excellence in quality, reliability, and thoroughness in all work tasks; detail-oriented with consistent follow-through
Knowledge of emerging technologies and familiarity with data qualiy automation
Nice to have
Experience with Mongo, PostgreSQL, Cassandra, working with distributed data models.
About the Company
At Astrapia, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help us become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.