AWS Glue Developing ETL pipelines, working with Glue Catalog, and transforming data using PySpark
AWS Lambda Writing serverless functions (Python, Node.js) to process, move, or transform data
AWS S3 Managing storage, organizing Qualtrics input/output files, and optimizing data retrieval
AWS Step Functions Orchestrating Glue and Lambda jobs into automated workflows
AWS Athena Querying structured data stored in S3 for quick analysis
AWS CloudWatch & Logging Monitoring job execution and debugging errors
AWS MWAA airflow for Jobs orchestration
2. Data Processing & ETL Skills
Data Transformation & Aggregation Merging dealer master and dealer employee files into a single hierarchy file
ETL Workflow Automation Automating ingestion, transformation, and report generation
Data Format Handling Processing CSV, JSON, or XML files from Qualtrics
3. API & Integration Skills
Qualtrics API Extracting raw data, managing survey responses, and automating data pull
AWS Event-Driven Processing Triggering Lambda jobs based on new files arriving in S3
Integration with External Systems Connecting AWS with CRM, ERP, or BI tools
4. Data Analysis & Reporting
Data Validation & Quality Checks Ensuring accuracy in processed files before Qualtrics ingests them Report File Generation Formatting data outputs as per business-defined templates
Basic SQL & Athena Queries Extracting insights from processed data
5. Programming & Scripting
Python Writing data processing scripts for Lambda, Glue (PySpark), and automation
SQL Querying and managing structured datasets
Shell Scripting (Bash) Automating file movement and data preparation
6. DevOps & Security (Nice to Have)
IAM Permissions & Role Management Ensuring AWS services have correct access
Infrastructure as Code (IaC) Using Terraform or CloudFormation for AWS resource setup
CI/CD for Data Pipelines Automating deployment of Lambda and Glue scripts
Pi-square technologies is a Michigan (USA) Headquartered Automotive Embedded Engineering Services company, Synergy Partner for major OEMs and Tier 1s and their implementation partners in Automotive Embedded Product Development, Projects, Requirements Analysis, Software Design, Software Implementation, Efficient Build, Release Process, and turnkey software V & V Services. We have more than 20+ years of industry expertise with specialization in the latest cutting-edge automotive technologies such as Infotainment, connected vehicles, Cyber security, OTA, and Advanced Safety/ Body electronics.
...Bravo, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming... .... Job Description Noticias Telemundo is seeking a Podcast Producer to lead the production of our flagship podcast hosted...
&##128680; Now Hiring: Chemical Operator | Join Our Team and Power the Process!&##128205; Location: Rock Hill, SC.&##128338; Schedule: Full-Time | 8-, 10-, or 12-hour shifts (Overtime & Weekend Opportunities!)&##128181; Pay Type: Hourly | Non-Exempt Are...
...Earth View is looking for a Horizontal Directional Drill Mechanic to join our team. The Horizontal Directional Drill (HDD) Mechanic's primary... ...responsibilities include the repair and maintenance of the Company's horizontal directional drill equipment. Benefits Competitive...
...SEO-led copywriter, you will have the required skills, ability and work ethic to create polished, high-quality copy on deadline for a... ...talkative and wants to learn on the go This is a remote (work from home) role but candidate must be located in the Philippines This...
...succeed, and make a real differenceall from the comfort of your home! Why Globe Life AO? Grow Your Skills: Learn and grow with our... ...competitive pay, bonuses, and opportunities to increase your earnings. Work Your Way: Enjoy the flexibility to choose your own hours and...