Bay Area In-Memory Computing Meetup

Expand all | Collapse all

Next meetup is scheduled for June 24 in Menlo Park!

  • 1.  Next meetup is scheduled for June 24 in Menlo Park!

    Posted 06-17-2019 07:24 PM
    Join us June 24 in Menlo Park! We'll have 3 valuable talks, a delicious BBQ dinner and amazing summertime-themed raffle prizes! This is a free event but you must RSVP to attend because space will be limited. Register here.

    > Talk 1: "Feeding data to the Kubernetes beast: bringing data locality to your containerized big data workloads." With Bin Fan, founding engineer of Alluxio, Inc. and PMC member of Alluxio open source project.
    > Talk 2: "Best Practices for Native Persistence and Data Recovery." With Valentin (Val) Kulichenko, lead architect at GridGain Systems.
    > Talk 3: Using In-Memory technology for real time analytics. With Andy Rivenes is a Product Manager at Oracle for Database In-Memory.

    Raffle prizes.
    * 1st prize: REMALI 4K Sports Action Camera!
    * 2nd prize: Fitbit Inspire HR Heart Rate & Fitness Tracker!
    * 3rd prize: Polaroid Originals OneStep 2 VF - Summer Blue!
    [Register for the raffle here: ]

    Talk details
    >> Talk 1 (Val): As an in-memory computing platform, GridGain and Apache Ignite support native persistence that stores data and indexes transparently on non-volatile memory, SSD or disk. When persistence is enabled, memory becomes a cache for the most frequently used data and indexes. Native persistence is ACID-compliant, durable and enables immediate availability on a restart of each node. Data is never lost; GridGain supports full and incremental snapshots along with continuous archiving, and provides Point-in-Time recovery to an individual transaction.

    Val will share insights into the underlying architecture and best practices for implementing native persistence in production. His talk will cover:
    - An architectural overview of native persistence, and centralized backup and recovery
    - Tips and tricks for for configuring and managing persistence
    - Best practices for checkpointing, using the Write-Ahead Log (WAL) and restoring from a failure
    - Performance tuning recommendations to balance durability and performance, including how to create snapshots under load

    >> Talk 2 (Bin): The latest advances in container orchestration by Kubernetes bring cost savings and flexibility to compute workloads in public/hybrid cloud / multi cloud environment. Such architectures typically lead to physically separated compute and storage services, where S3, Azure Data Lake or Google Cloud Storage are commonly used to provide data persistence.

    Open source Alluxio approaches this problem in a new way. It helps elastic compute workloads realize the true benefits of the cloud, while bringing data locality and data accessibility to workloads orchestrated by Kubernetes. Alluxio can orchestrate data locality from any persistent storage including object store such as Ceph and cloud storage such as AWS S3 or GCS and make it accessible to compute running in Kubernetes pods. As a stateless data access layer (as opposed to a long-running data storage daemon service), Alluxio runs as a native service making data-intensive compute workloads Kubernetes friendly.

    Bin will explain how this new approach of bringing data locality to data-intensive compute workloads in Kubernetes environments. He'll also cover the Alluxio, architecture, deployment with Kubernetes and real-world production use cases.

    Tom Diederich
    Director of Community Engagement
    GridGain Systems

  • 2.  RE: Next meetup is scheduled for June 24 in Menlo Park!

    Posted 06-25-2019 03:36 PM
    Hi everyone, here's the recorded livestream of last night's meetup that was published to our YouTube page.

    Tom Diederich
    Director of Community Engagement
    GridGain Systems

Would you attend a July Meetup?


  • How to get one FREE ticket to the In-Memory Computing Summit

    Would you like to snag a FREE ticket to the In-Memory Computing Summit, Nov. 13-14 in San Francisco? Here's all you need to do:

    Create a free user account on these forums, then navigate to the Bay Area In-Memory Computing Meetup category and subscribe by clicking "Join Forum" in the upper right part of the screen. It's that simple! I'll then send you an email with the code needed for your free ticket.
    Bay Area IMC Meetup

  • Bay Area In-Memory Computing Meetup forum

    Welcome to the official forums for the Bay Area In-Memory Computing Meetup! This is the place to ask our speakers questions and also download their slides and any videos. Here's the link to the meetup page.