Data Integration Engineer

Description

About O’Reilly Media

O’Reilly’s mission is to change the world by sharing the knowledge of innovators. For over 45 years, we’ve inspired companies and individuals to do new things—and do things better—by providing them with the skills and understanding that’s necessary for success.

At the heart of our business is a unique network of experts and innovators who share their knowledge through us. O’Reilly Learning offers exclusive live training, interactive learning, a certification experience, books, videos, and more, making it easier for our customers to develop the expertise they need to get ahead. And our books have been heralded for decades as the definitive place to learn about the technologies that are shaping the future. Everything we do is to help professionals from a variety of fields learn best practices and discover emerging trends that will shape the future of the tech industry.

Our customers are hungry to build the innovations that propel the world forward. And we help you do just that.

Diversity

At O’Reilly, we believe that true innovation depends on hearing from, and listening to, people with a variety of perspectives. We want our whole organization to recognize, include, and encourage people of all races, ethnicities, genders, ages, abilities, religions, sexual orientations, and professional roles.

Learn more: https://www.oreilly.com/diversity 
 

About the Team 

Our data platform team is dedicated to establishing a robust data infrastructure, facilitating easy access to quality, reliable, and timely data for reporting, analytics, and actionable insights. We focus on designing and building a sustainable and scalable data architecture, treating data as a core corporate asset. Our efforts also include process improvement, governance enhancement, and addressing application, functional, and reporting needs. We value teammates who are helpful, respectful, communicate openly, and prioritize the best interests of our users. Operating across various cities and timezones in the US, our team fosters collaboration to deliver work that brings pride and fulfillment. 
 
    
About the Role 

We are seeking an experienced and detail-oriented Data Integration Engineer to contribute to the development and expansion of a suite of systems and tools, with a primary focus on ETL processes. The ideal candidate will have a deep understanding of modern data engineering concepts and will have shipped or supported code and infrastructure with a user base in the millions and datasets with billions of records. The candidate will be routinely implementing features, fixing bugs, performing maintenance, consulting with product managers, and troubleshooting problems. Changes you make will be accompanied by tests to confirm desired behavior. Code reviews, in the form of pull requests reviewed by peers, are a regular and expected part of the job as well.
 
Salary Range: $110,000 – $138,000

What You’ll Do 

  • ETL Development with Talend:
    • Architect and build complex ETL pipelines in Talend Data Integration, ensuring scalability, reusability, and maintainability of workflows.
    • Implement sophisticated data transformations, including lookups, joins, aggregates, and custom routines using Talend’s tMap, tJavaRow, tSQLROW and JSON components.
    • Develop data pipelines or features related to data ingestion, transformation, or storage using Python and relational databases (e.g., PostgreSQL) or cloud-based data warehousing (e.g.,BigQuery)
    • Automate data ingestion from REST APIs, FTP servers, cloud platforms, and relational databases into cloud or on-premises storage.
    • Leverage Talend’s integration with BigQuery for seamless data flow into analytical systems, employing native connectors.
    • Familiarity with Talend’s debugging tools, logs, and monitoring dashboards to troubleshoot and resolve job execution issues.
    • Optimize Talend jobs by using efficient memory settings, parallelization, and dependency injection for high-volume data processing.
    • Integrate Talend with Google Cloud Storage, Pub/Sub, and Dataflow to create hybrid workflows combining batch and real-time data processing.
    • Manage Talend deployments using Talend Management Console (TMC) for scheduling, monitoring, and lifecycle management.
  • BigQuery Data Management:
    • Build high-performance BigQuery datasets, implementing advanced partitioning (DATE, RANGE) and clustering for cost-effective queries.
    • Proficient in working with JSON and ARRAY data structures, with expertise in leveraging BigQuery to efficiently nest and unnest objects as required for complex data transformations and analysis.
    • Write advanced SQL queries for analytics, employing techniques like window functions, CTEs, and array operations for complex transformations.
    • Implement BigQuery federated queries to integrate external datasets from Cloud Storage or other data warehouses.
    • Fundamental understanding of Designing and managing BigQuery reservations and slots involves allocating compute resources effectively to balance performance, cost, and workload demands across various teams and projects.
  • Real-time Data Pipelines with Google Pub/Sub and Dataflow:
    • Implement Pub/Sub topics and subscriptions to manage real-time data ingestion pipelines effectively.
    • Integrate Pub/Sub with Talend for real-time ETL workflows, ensuring low-latency data delivery.
    • Implement dynamic windowing and triggers for efficient aggregation and event handling.
    • Optimize streaming pipelines by fine-tuning autoscaling policies, worker counts, and resource configurations.
  • PostgreSQL Database Development and Optimization:
    • Be able to enhance, modify existing PostgreSQL queries and functions
    • Write advanced PL/pgSQL functions and triggers for procedural data logic.
    • As needed develop materialized views and indexed expressions to speed up query execution for large datasets.
    • Monitor and optimize queries through EXPLAIN/ANALYZE.

What You’ll Have 

Required: 

  • 6+ years of professional data engineering experience (equivalent education and/or experience may be considered)
  • Strong experience with Talend Data Integration for designing and optimizing ETL pipelines
  • Excellent Python and PostgreSQL development and debugging skills
  • Experience in data extraction, transformation, and loading (ETL) using Python.
  • Experience working with JSON and ARRAY data structures in BigQuery, including nesting and unnesting
  • Experience in integrating and optimizing streaming data pipelines in a cloud environment
  • Experience with deployment tools such as Jenkins to build automated CI/CD pipelines
  • Hands-on experience with Google Cloud Storage, Pub/Sub, Dataflow, and Dataprep for ETL and real-time data processing
  • Proficient in building and managing real-time data pipelines with Google Pub/Sub and Dataflow
  • Proficient in BigQuery, including dataset management, advanced SQL, partitioning, clustering, and federated queries
  • Solid understanding of PostgreSQL, including PL/pgSQL, query optimization, and advanced functions
  • Familiarity with optimizing BigQuery performance through reservations, slots, and cost-effective query techniques
  • Proven experience in creating, managing, and merging branches in Git, following best practices for version control.
  • Expertise in resolving merge conflicts, with a deep understanding of branching strategies, rebasing, and other Git workflows.
  • Extensive experience with GitHub pull requests (PRs), including creating, reviewing, and approving code changes in a collaborative environment.
  • Excellent problem-solving skills and ability to optimize high-volume data workflows
  • Strong communication skills to collaborate effectively with cross-functional teams
  • Strong drive to experiment, learn and improve your skills
  • Respect for the craft—you write self-documenting code with modern techniques
  • Great written communication skills—we do a lot of work asynchronously in Slack and Google Docs
  • Empathy for our users—a willingness to spend time understanding their needs and difficulties is central to the team
  • Desire to be part of a compact, fun, and hard-working team

Preferred:

  • Experience Integrating BigQuery ML for advanced machine learning use cases, including regression, classification, and time-series forecasting.

UX Lab Analysts (Remote)

Post Date

May 13, 2025

Location

Cary,
North Carolina

ZIP/Postal Code

27518

Job Type

Contract

Category

QA

Req #

RAL-782156

Pay Rate

$18 – $22 (hourly estimate)

Job Description

Insight Global’s client, a leading company within the gaming industry, is looking for 5 UX Lab Analysts to join their UX Research team as a contractor for 12 months. In this role, you will be doing important ground work in data collection for user research. You will be responsible for participating in and observing research prep and execution, as well as working on the testing process.
– Observing participants during UX tests
– Compiling results from observation so Epic’s UX Researcher can draw conclusions
– Participating in research analysis, as needed
– Recruiting participants for UX tests

We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form. The EEOC “Know Your Rights” Poster is available here.

To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Required Skills & Experience

– Strong interest in video games / gaming
– Understanding of UX and why it’s important
– Understanding of and passion for usability and user research
– Strong people skills, organizational skills, note taking skills and time management skills

Nice to Have Skills & Experience

– Degree in Human Factors, Psychology, Human Computer Interaction, User Experience, or a similar field
– Any relevant experience within this space

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Java Web Back End developer – Capital Markets

Java Web Back End developer – Capital Markets

Job ID: 25-08937

Job Title: Java Web Back End developer – Capital Markets

Location: New York, NY 10036 (100% Remote)

Duration: 6 Months

Contract Type: W2 only

Pay Rate: $103.44/Hour

Role Mandate:

  • Understands that the success of a developer is to understand the core business processes of the business unit and business requirements as well as the architecture patterns and technology strategy (e.g., Transformation, SmartCore, DevOps). Conceive and write detailed software implementations/code while ensuring that their code/configurations adhere to the security, logging, error handling, and performance standards and non[1]functional requirements. Writes, configures, and integrates code to create the software that aligns with architecture patterns and technology strategy.
  • Understands the implications of various components (including technology strategy & architecture) to the overall design of a program, system, or eco-system.
  • Evaluates new technologies for fit with the program/system/eco[1]system and the associated upstream and downstream impacts on process, data, risk (e.g., security). Works toward the objective of defect free software.
  • Ensures that systems functionally meet requirements, align with architecture and promote the development of common assets. Supports the resolution of production issues and problems.

Role Responsibilities Include (but are not limited to):

  • Supports research and development of development frameworks, and definition of standards.
  • Leads and implements initiatives as required to deliver business objectives.
  • Conducts independent analysis and assessment to resolve strategic issues.
  • Builds effective relationships with internal/external stakeholders and ensures alignment.
  • Monitors and tracks performance and addresses any issues.
  • Reviews the work of other team members as required.
  • Provides input into the planning and implementation of operational programs.
  • Decomposes business requirements and translates them into detailed design specifications and code.
  • Interacts with key business & technology stakeholders to define, analyze, and deliver requirements that reflect the needs of both the business and end-customers.
  • Assesses the costs and benefits for different solutions and recommend/decide on appropriate designs.
  • Designs solutions, writes code, performs unit testing, develops appropriate artefacts / documentation, and facilitates final delivery.
  • Supports production issues, includes independently completing root-cause analysis and diagnosis.
  • Devises new algorithms and data structures for target environment and platform attributes in alignment with architectural patterns.
  • Builds solutions that are supportable, scalable and achieve our aspiration of common assets.
  • Recommends or automates approaches to streamline and integrate technological processes and/or systems to improve operational efficiency and effectiveness.
  • Supports the management of specific project deliverables & outcomes.
  • Identifies opportunities to strengthen the development capability, such as: sharing expertise to promote technical development, mentoring employees, building communities of practice and networks.
  • Stays abreast of industry technical and business trends through participation in professional associations, practice communities & individual learning.

Must-Have Skills:

  • Typically 8+ years of work experience in Web Technologies, IT or business environment and/or B.S./B.A. in computer science, engineering, information systems, math or business
  • Exceptional experience with Java, web backend development
  • Experience with restful API, MQ/Kafka, SQL DB
  • Experience with AWS cloud environment (ECR, ECS, lambda, security aspects)
  • Experience with DevOps
  • Experience with the Junit and Jasmine Testing Frameworks
  • Experience with AWS Non-SQL DynamoDB is a plus
  • Experience with web font-end development (JavaScript, HTML5, CSS3, TypeScript) is aplus.
  • Experience with large software system development
  • Proficient level of knowledge in domain.
  • Knowledge of software development practices, concepts, and technology obtained through formal training and/or work experience.
  • Knowledge of required programming languages and can code with little oversight.
  • Knowledge of technical/business environment and processes.
  • Understand functional aspects and technical behavior of the underlying operating system, development environment, and deployment practices.
  • Have facility with and understanding of the ecosystem that code operates in.

IT Software Engineer III (Java) – Remote

Job Description

Posted Thursday, March 27, 2025 at 12:00 AM

Paradigm is an accountable specialty care management organization focused on improving the lives of people with complex injuries and diagnoses. The company has been a pioneer in value-based care since 1991 and has an exceptional track record of generating the very best outcomes for patients, payers, and providers. Deep clinical expertise is the foundation for every part of Paradigm’s business: risk-based clinical solutions, case management, specialty networks, home health, shared decision support, and payment integrity programs.

We are seeking a full-time, remote Software Engineer III position. This position will be responsible for developing and maintaining an application primarily written in mix of platforms and will be performing the technical analysis, design, development or evaluation of products, unit testing and implementation of computer software as assigned.  This position will assist with backend and web application’s user interface development across these technologies.

RESPONSIBILITIES:

  • Researching, designing, writing and testing new software programs.
  • Develops design specifications for required software and hardware (based on requirements).  Works with other ITS personnel to ensure design meets corporate technical standards and direction.  Performs design specifications review with other members of the development team.
  • Develop software to meet software design specifications OR develop existing systems by analyzing and identifying areas for modification.
  • ‘Bolting together’ existing software products (getting incompatible platforms to work together and creating code to link them).
  • Maintaining systems by monitoring, identifying and correcting software defects.
  • Investigating new technologies and providing input to the current software selection tool for a development project.
  • Create and update technical documentation using high level technical specification documents.
  • Create unit test plans and conduct unit testing accordingly.
  • Writing operational deployment documentation and other technical documentation needed by an application.
  • Working closely with other staff, such as project managers, business systems analysts, and DBA; consulting colleagues concerning the maintenance and performance of software systems and asking questions to obtain information, clarify details and implement information.
  • Constantly updating technical knowledge and skills by attending in-house, web casts and/or external courses, reading manuals and accessing new applications.
  • Problem-solving and thinking laterally as part of a team, or individually, to meet the needs of the project.
  • Participate in architecting, designing and delivering system software after specification of platform requirements.
  • Trains or assists in the training of IT’S and user personnel in the conversion and implementation of the developed or purchased software.
  • Performs project planning by identifying needed tasks and deliverable, time estimation, and defining target date for completion on an assigned project.  Implement project plan with assigned team.  Communicates status of work to direct supervisor and assigned project team members(s).
  • Ensures quality of work following system development and maintenance life cycle standards.  Recommends changes in system development and maintenance standards.
  • Maintains support, troubleshoots and enhances current Production applications as assigned.

QUALIFICATIONS:

  • Technical proficiencies/knowledge:
    • Bachelor’s Degree in CS, MIS, CE, or similar field of study. 
    • A minimum of eight (8) years of Object-Oriented Development Particularly N-Tier programming development in a distributed systems environment OR any combination of academic education, professional training, or work experience which demonstrates the ability to perform the duties of the position, Experience with all the phases of software engineering.
    • 5 years of full-stack Java application development experience.
    • Excellent Java coding background including familiarity with the following JavaScript
    • GitHub, Jenkins Pipeline, Spring Framework, Java, understanding of messaging systems like MQ, Rabbit MQ, Kafka or Kinesis.
    • Knowledge of either SQL Server preferred, DB2 or Oracle required.
    • Good knowledge of SQL, SQL tuning, writing complex queries required.
    • Knowledge of Agile methodologies (especially Agile Scrum) and test-driven development.
    • Knowledge of Azure DevOps, Azure API APIM, Gateway and exposure to AKS preferred.
    • Ability to lead in the analysis, design, development, testing, and implementation of solution.
    • Ability to do data analysis, data structure design.
    • Excellent command of rapid application design (RAD) concepts.
  • Required non-technical proficiencies and knowledge:
    • Excellent interpersonal/written/verbal communication and listening skills necessary. 
    • Exhibit self-motivation for success in a fast-paced, dynamic and unstructured environment.
    • Ability to adapt and be open to frequent changes in work environment and prioritization.
    • Ability to manage multiple competing deadlines.
    • Ability to be innovative and creative with solution design and programming solutions.
    • Exhibit good analytical and problem-solving skills.
    • Ability to be a self-starter, self-directed and to enjoy fast-paced work.
    • Ability to work seamlessly with both large and small teams to design and develop complex strategic business software solutions.
    • Ability to use leadership skills to develop a cohesive team environment.
    • Ability to lead a development project team throughout the development phase.
    • Ability to use good, practical, balanced and fair judgment when to escalate team member’s tasks or projects assigned that will impose risk to the timeline or cost of the project.

Paradigm believes that fostering a diverse and inclusive workplace is central to our mission of helping more people and transforming lives. We’re striving to build a culture that better reflects the society we live in and empowers our team to deliver the highest levels of compassion and care to those we serve. For us, achieving this goal requires a workforce that respectfully embraces differences and commits to positive change, creating an environment where everyone is able to bring their whole self to work.

We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.

AWS Cloud Engineer- Windows

Post Date

May 12, 2025

Location

Herndon,
Virginia

ZIP/Postal Code

20170

Job Type

Contract

Category

Computer Engineering

Req #

SDG-781991

Pay Rate

$48 – $60 (hourly estimate)

Job Description

A client is looking for a fully remote AWS Cloud Engineer to join their team. The ideal candidate will become part of a Data Center and Cloud Optimization program providing Tier 3 support to the Homeland Advanced Recognition Technology biometric system. The Tier 3 team works to maintain the infrastructure by installing and configuring system software and hardware, monitoring system performance, resolving customer tickets within JIRA and supporting system incident troubleshooting calls. Tier 3 members closely interact with the customer to achieve system objectives, provide ticket updates, and system status updates. They will be responsible for maintaining the infrastructure that is developed, patching, and creating playbooks to make processes easier, faster, and more efficient. Tier 3 members are expected to be on-call for a week at a time approximately 4 — 6 times a year. This is a fully remote role working 9-3pm EST for their core hours.

We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected]. The EEOC “Know Your Rights” Poster is available here.

To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Required Skills & Experience

-Ability to obtain DHS EOD
-Minimum of 5 years of IT experience
-Experience administering Windows systems in a cloud environment

Nice to Have Skills & Experience

-Bachelor’s degree in Computer Science, Mathematics, or Related STEM field.
-Cloud Systems Administration experience; AWS certifications a PLUS.
-Experience using and performing system administration for CyberArk
-Expert knowledge of RHEL, Windows, & other open-source technologies.
-Knowledge of OpenShift, Splunk, Ansible Automation Platform, Jenkins, JFrog, and similar
toolsets
-Experience using below program technologies:
* AWS GovCloud (AWS Console)
* SNOW
* RedHat OpenShift
* Ansible and Docker containers
* Ansible Automation Platform
* Aurora AWS (PostgreSQL) database
* Gitlab and Jenkins pipeline
* CyberArk
* Splunk
* SonarQube
* Jenkins

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.