Azure Data Engineer Job at Lorven technologies, Weehawken, NJ

NGYwajNuWWxiREgzSnUrdDJ6WjRMTzdoV1E9PQ==
  • Lorven technologies
  • Weehawken, NJ

Job Description

Title : Azure Data Engineer .

Location :Weehawken, NJ

Type :fulltime

Required Skills :SQL, datamodelling , ETL ,Spark, Kafka, Hive , Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service

Job Description:

  • Bachelor's or Master's degree in Computer Science, Information Systems, Finance, or a related field.
  • Expert level skills writing and optimizing complex SQL
  • Experience with complex data modelling, ETL design, and using large databases in a business environment
  • Experience with building data pipelines and applications to stream and process datasets at low latencies
  • Fluent with Big Data technologies like Spark, Kafka and Hive
  • Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required
  • Designing and building of data pipelines using API ingestion and Streaming ingestion methods
  • Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential
  • Experience in developing NO SQL solutions using Azure Cosmos DB is essential
  • Thorough understanding of Azure and AWS Cloud Infrastructure offerings
  • Working knowledge of Python is desirable
  • Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services
  • Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB
  • Monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance
  • Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information
  • Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
  • Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
  • Documenting data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards
  • Providing guidance and support for data governance, including metadata management, data lineage, and data cataloging

Job Tags

Full time,

Similar Jobs

Maddisoft

Mobile Application Developer Job at Maddisoft

 ...sponsorship is available for this position. Job Title: Mobile Application Developer Location: Pontiac, MI (Hybrid) Job Description...  ...Agile methodologies, UI/UX design principles Deployment: App Store and Google Play submission processes Monitoring... 

Professional Alternatives

Inside Sales/Quoting Specialist Job at Professional Alternatives

 ...Job ID#: 34253 I nside Sales Quoting Specialist Needed for growing energy company!Great Cypress area location Bonus and growth potential 50K + with experience This roleplays a critical role in supporting service operations by managing parts procurement... 

DEPT OF HEALTHMENTAL HYGIENE

Senior Early Childhood Education Consultant, Bureau of Childcare Job at DEPT OF HEALTHMENTAL HYGIENE

 ...Job Description Open to candidates who are permanent or to those who successfully filed for CONSULTANT (EARLY CHILDHOOD EDUCATION) Exam No. 5059 within the filing period: From: March 5, 2025, To: March 25, 2025 The Bureau of Child Care ensures that child... 

VRK IT Vision Inc

Network Security Specialist/Forensic Analyst Job at VRK IT Vision Inc

 ...Hi, Job Title : Network Security Specialist/Forensic Analyst Location - Ocoee FL. On-Site...  ...digital evidence from various sources to support investigations and root cause...  ...or Master's degree in Cybersecurity, Computer Science, or a related field.... 

Egon Zehnder

Technology Practice, Associate Researcher Job at Egon Zehnder

 ...seeking a highly motivated and proactive Associate to join our Research team serving North America based in Montreal. In this fast-paced...  ...of a similar nature (e.g., market research, qualitative or legal research, professional services/consulting, project planning)...