General Questions

Expand all | Collapse all

I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

  • 1.  I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 08-26-2019 08:59 AM
    Hi All, 
    I want to persist all changes on the ignite to RDMBS or myssql database. Can this be done with automatic persistance ? How can this be achieved with any configuration with POJO? 



    Let me know . Thanks

    ------------------------------
    kumar Pinumalla
    Data Engineer
    MES,Inc.
    2038098670
    ------------------------------


  • 2.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 08-27-2019 03:37 AM
    Hello!

    The results of DML operations will be persisted to underlying cache store.
    DDL cannot be persisted to underlying store, nor will DDL reconfigure cache store to e.g. make use of new columns.

    Regards,

    ------------------------------
    Ilya Kasnacheev
    Community Support Specialist
    GridGain
    ------------------------------



  • 3.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 08-27-2019 07:28 AM
    Got you. I want to persist the data in cache store to RDBMS ( Like mysql) . Will it be possible what ever is updated in the cache store in ignite to mysql server( In simpler way , I want to replicate the changes in cache storage to mysql server) . What configurations needs to be done? is it possible ?

    ------------------------------
    kumar Pinumalla
    Data Engineer
    MES,Inc.
    2038098670
    ------------------------------



  • 4.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 08-27-2019 07:32 AM
    Hello!

    writeThrough=true should suffice.

    Please see the documentation for examples: https://apacheignite.readme.io/docs/3rd-party-store

    Regards,

    ------------------------------
    Ilya Kasnacheev
    Community Support Specialist
    GridGain
    ------------------------------



  • 5.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 08-27-2019 09:07 AM
    Edited by kumar Pinumalla 08-27-2019 09:10 AM
    Hi,
    I am currently using the community edition . Can I just download the POJO configuration from the folllowing link provided above. how to deploy the POJO configuration on grid gain community edition  ? Any docs to deploy on community edition ? if there any configurations to buffer the mysql server for some time and catch back later after the mysql is restarted/patched? 

    Thank you

    ------------------------------
    kumar Pinumalla
    Data Engineer
    MES,Inc.
    2038098670
    ------------------------------



  • 6.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 08-27-2019 09:19 AM
    Hello!

    I recommend running/tweaking some examples from the examples/ directory of GGCE distribution to get hold of things.

    It also has Cache Store example which you can use as a starting point of your project.

    Be sure to come back with questions if you have any while tinkering with examples.

    Regards,

    ------------------------------
    Ilya Kasnacheev
    Community Support Specialist
    GridGain
    ------------------------------



  • 7.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 09-05-2019 11:35 AM
    I have attached the folder with making all the changes from web console

    ------------------------------
    kumar Pinumalla
    Data Engineer
    MES,Inc.
    2038098670
    ------------------------------



  • 8.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 09-05-2019 11:37 AM
      |   view attached
    I tried with all changes and I am getting same error

    ------------------------------
    kumar Pinumalla
    Data Engineer
    MES,Inc.
    2038098670
    ------------------------------

    Attachment(s)

    zip
    Cluster1-project.zip   13K 1 version


  • 9.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 09-10-2019 06:59 AM
    Hello!

    I was able to make this project run after some minor tweaks:
    I've supplied localAddress and addresses for Discovery SPI, turned off eviction policy on test cache, and set localPort on Discovery SPI to match addresses. Then it would boot. I did not check mysql since I don't have your DB. And there was also some package glitch in one of files.

    What's the IDE that you are using? I did that with IDEA. Maybe you need to mark resources as 'production resources root'?

    Regards,

    ------------------------------
    Ilya Kasnacheev
    Community Support Specialist
    GridGain
    ------------------------------



  • 10.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 09-10-2019 08:56 AM
    Hi , 
    I am not currently using any IDE. I am directly running it on the Linux server directly invoking server.xml file ( ./ignite.sh /path/to/resource/server.xml . How do you want me to deploy on the cluster . can yo resend me code so that I can run on the server and try if it works with the mysql configuration details according my environment. 


    ------------------------------
    kumar Pinumalla
    Data Engineer
    MES,Inc.
    2038098670
    ------------------------------



  • 11.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 09-10-2019 08:58 AM
    Hello!

    You can try mvn exec:java -Dexec.mainClass=startup.ServerNodeCodeStartup

    Of course, you will need to build the project first with mvn clean install.

    Regards,

    ------------------------------
    Ilya Kasnacheev
    Community Support Specialist
    GridGain
    ------------------------------



  • 12.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 09-10-2019 10:29 AM
    Hi IIya,
    we did not have access to maven packages as we cannot go out from the network. can I do the built on windows machine using the Eclipse IDE and deploy it on the linux server/ 

    can we do it this way?

    ------------------------------
    kumar Pinumalla
    Data Engineer
    MES,Inc.
    2038098670
    ------------------------------



  • 13.  RE: I wanted to check , I want to persist all DDL, DML operations from ignite cluster to Mysql database?

    Posted 09-11-2019 01:34 AM
    Hello!

    You can ask Maven to download all dependencies, however, it is a question that is outside of scope of GridGain discussions.

    Regards,

    ------------------------------
    Ilya Kasnacheev
    Community Support Specialist
    GridGain
    ------------------------------



Would you attend a July Meetup?


Announcements