We help IT Professionals succeed at work.

NoSQL Databases

182

Solutions

337

Contributors

A NoSQL database provides a mechanism for storage and retrieval of data which is modeled in means other than the tabular relations used in relational databases. Motivations for this approach include: simplicity of design, simpler "horizontal" scaling to clusters of machines and finer control over availability. The data structures used by NoSQL databases (e.g. key-value, wide column, graph, or document) are specified from those used by default in relational databases, making some operations faster in NoSQL. Sometimes the data structures used by NoSQL databases are also viewed as "more flexible" than relational database tables.

dear all,

I am reading this:

http://azure.microsoft.com/blog/2015/04/08/nosql-database-service-azure-documentdb-now-generally-available/

What is DocumentDB for ? only as a purpose on allowing applications to query and process JSON data at scale ? and it is delivered as a fully managed database-as-a-service (DBaaS) with built in high availability, SQL query over indexed JSON and multi-document
transaction processing.
?

what good is noSQL when compare with tranditional SQL ?

did DocumentDB compliance with ACID and SQL compliance ? it should not be as it is not tranditional SQL, like MS SQL, Oralce and DB2 ?
0
For some business web application in the future I would like to use this constellation :
- web site designed in in html/css/javascript/JQuery (Single Page)
- using https
- using stateless authentication
- get content/data (maybe sensitive) from web services (HttpSelfHostServer with Prepared SQL Statements) returning JSON to the Javascript site

I read much about web site security and I'm worried about the fact, if this is a secure combination.

Can you help me to get a recommendation ?
Is there a kind of trap I will fall into ?

Thanks for your evaluation (and the appropriate arguments).

Gerhard
0
How to convert 250 tables data with 90 GB of database data to mongodb. please let me know the approach

Thanks
0
If I wanted a PaaS with the following options:

> Good Market share so it will be around ain a coupl eyears

> Mongo DB

> AMQP 1.0 Provider

>  and of course an Apache

Which PaaS would I choose
0
I have a mongodb document that is autogenerated that uses dashes in field names.  How do I construct a query or assignment that uses them ?   It doesn't like embedded dashes and I can't figure out how to escape the field names so I can use them as variables in expressions.

 
"Doc" : [
  {
    "field-1" : "alpha",
    "stuff": {
       "more-stuff" :  1,
       "even-more-stuff" : 2,
       "embedded-array" : [ 
          {
            "e-1": 100, 
           "e-2":101
          }
       ]
      } 
  },
  {
     "field-1" : "beta",
     "stuff": {
       "more-stuff" :  3,
       "even-more-stuff" : 4,
       "the-cookie":55
        } 
  }
]

Open in new window


How would I assign x to the field name associated with "The cookie" and then, so It is a better learning experience, create a cursor on "embedded-array" so a jsonprint(EmbeddedArray")  reports the e-1 and e-2 fields and values?
0
I have a Node project which uses Express and MySQL, but I need an ORM. I have heard good things about Waterline.

What can you tell me about which ORM to use? Do I need Sales.JS if I want Waterline?

I have a new project so it's the best time for new frameworks, and would consider Sales.JS is there was real benefit. But I do consider the current framework to be MVC, which I suspect comes from Express: Models, Views and Routes.

I like Waterline since I may need MongoDb at some point, but expect to use MySQL exclusively, for a long while.

Thanks!
0
I am starting on my first node.js project and I want to try making a web scraper. I plan on using a MongoDB instance to store urls and filters I want to scrape and I want to use node.js to process the tasks I send to it. I imagine the process to be as follows:

1. I manually add URLs to the MongoDB in a task queue table
2. My script constantly runs in a loop and checks the database for new tasks.
3. If a new task is found, the node.js script starts an instance of my downloader script to start downloading data from the task URL
4. While the first task is working, I want the main script to check if the database has any additional records and start the downloader script as a new instance. Lets assume I want up to 5 instances running at a time.
5. After an instance of the downloader script finishes, it stores the downloaded data for later processing by a different scripts and marks the task queue item as complete.

As a node.js beginner I still have much to learn but is there a special design pattern I should follow to allow this multi-threaded/asynchronous operation?
0
I've chosen to store all my companies products in MongoDB because we have a wide array of different items, all with different specifications.  So far, MongoDB has worked out great for our needs because we are able to completely customize each document to fit the exact specifications for our products.

With most of our items having measurements held within the specs, I'm looking to store the value of a the measurement in one field and the unit of measure in another.  The problem comes in when I have something that is 9' 9" or 30" X 20" X 25".

This is what I have currently, and remember this is in MongoDB.

{
     "category" : "547295b360557a18b87c4f2f",
     "category_id_old" : "2",
     "category_grp" : "H0004",
     "old_item_id" : "6",
     "model_number" : "Brick Basket",
     "capacity" : "400 lbs.",
     "weight" : "60 lbs.",
     "size" : "30\"x20\"x12\""
}

{
     "category" : "547295b760557a18b87c4f83",
     "category_id_old" : "75",
     "category_grp" : "H00030",
     "old_item_id" : "1727",
     "model_number" : "Eye-to-Eye",
     "capacity" : "5.6",
     "wire_rope_size" : "19\' 1\"",
     "size" : " 3/4\""
}

Open in new window


Here is what I would like to do:

{
     "category" : "547295b360557a18b87c4f2f",
     "category_id_old" : "2",
     "category_grp" : "H0004",
     "old_item_id" : "6",
     "model_number" : "Brick Basket",
     "capacity" : "400",
     "cap_uom" : "lbs", 
     "weight" : "60",
     "weight_uom" : "lbs", 
     "size" : "30\"x20\"x12\""
     "size_uom" : " ????? "
}

{
     "category" : "547295b760557a18b87c4f83",
     "category_id_old" : "75",
     "category_grp" : "H00030",
     "old_item_id" : "1727",
     "model_number" : "Eye-to-Eye",
     "capacity" : "5.6,
     "cap_uom" : "in."
     "wire_rope_size" : "19\' 1\"",
     "wire_rope_uom" : " ?????",
     "size" : " 3/4"
     "size_uom" : "in."
}

Open in new window


I've thought about possibly converting all the feet to inches, but then I'd need to have a flag on when to convert it back to feet, and when not to.  In the first product example, the size of 30" x 20" x 12" needs to stay in inches, but if I were to convert the wire_rope_size to inches, that would need to be converted back to 19' 1" when I display it on quotes for the customers.  

Thank you for any guidance you could provide.
0
Hi,

I'm wondering what are the best practices for setting up a PHP session distributed system (for Login Authentication and Authorization) using MySQL or perhaps NoSQL (maybe Reddis or MongoDB). Should I use Node.js with a NoSQL? If so, what are some good thorough books or online tutorials where I can learn more. I don't know much about NoSQL and I'm just learning Node.js but know Javascript.

I'm reading this whitepaper:
http://www.mysql.com/why-mysql/white-papers/unlocking-new-value-from-web-session-management/

and it gives some overview but I'm wondering how other professionals are tackling the issues too.

Can you give me some good books to read or links please? =)

I'll be using PHP Laravel for the backend framework so I have to learn how to implement all of this or at least get going in the right direction.

Thanks. Father God bless you<>< =)
0
I am considering using the Sails.js framework for Node, which is an MVC framework. It includes an ORM called Watermark, which interfaces with MySql and MongoDb.

Has anyone got experience with this?

I want:

- a Node back-end (at least I think I do)
- a way to organize the complexity in a large project (which MVC can offer)
- the ability to have SQL queries AND a JSON database which is lighting fast and highly scalable

Please provide some feedback on whether I am on the right track or not, or whether there is a better solution.

Thanks.
0
Hello Experts,

I need to store many images in the server.

     Is it good/best/correct to store  the image in the mongoDB? or to store the image on the disk, and storing the metadata of the image in the mongoDB.

Thanks.
0
I built a web page in VS 2012 that connects to a mongodb and returns records to a gridview. It works well. I am trying to recreate that page within SharePoint. I basically cut and pasted the code from the working page into the SharePoint site and then added the references to the mogodb drivers. The page compiles and builds without errors. When I go to run the page and click the search button to return the records from the mongodb, I get the error: Could not load the file or assembly 'MongoDB.Driver. . .' The system could not fins the file specified. Like I said, it works fine in the first web application, but not in SharePoint. I am completely new to SharePoint. Is there something I am missing with regards to references, or something else like that? Any ideas would be appreciated. It is SharePoint 2013, building the pages in VS 2012.
0
Hi Experts,

   I am currently looking for an e-commerce solution that is cost effective, easily scalable, faster development and high performance.

 We have an opportunity to use IBM tools(for 2 years) for initial setup as
IaaS & PaaS from IBM.

 We are in confusion now, whether to go with IBM WebSphere/Cloudant or Nodejs/MongoDB.

 From the above 2, which is the best trending technology for the e-commerce solution

  I was wondering if anyone can give me their expert opinions and insights on a feasible solution, this would be greatly appreciated.

Thanks..
0
I have a gridview that is bound to a table. The code is in C#, with the table in a MongoDB. The code returns the record from the database and displays in a gridview. I need to take the values displayed and insert them into a SQL server table. How can I get the values from thee gridview cells? The code I have so far is below from the code behind page:

using System; 
using System.Coliections.Generic; 
using System.Configuration; 
using System.Data; 
using System.Data.SqIClient; 
using System.Web; 
using System.Web.UI; 
using System.Web.UI.WebControls; 
using MongoDB.Bson; 
using MongoDB.Driver; 
using MongoDB.Driver.Builders; 

namespace MyWebSite 
{ 
public partial class FindEmployee : System.Web.UI.Page { 
protected void Page_Load(object sender, EventArgs e) 
{ 
} 

public class DataFromDB 
{ 
public string COMP { get; set; } 
public string FIRST_NAME { get; set; } 
public string LAST_NAME { get; set; } 
public string MIDDLE_NAME { get; set; } 
public string SSN { get; set; } 
} 


protected void ConnectMongoDB() 
{ 
var connectionString = "mongodb://test"; 
var client = new MongoClient(connectionString); 
var server = client.GetServer(); 
var database = server.GetDatabase("db"); 
var collection = database.GetColiection<LazyBsonDocument>("entity_map"); 
var inserted = tbSSN.Text.ToStringO; 
var q = Query.Matches("SSN.data", "^" + inserted + ".*"); 
 
String[] String Names = new String[] { "COMP", "FIRST_NAME", "LAST_NAME", "MIDDLE_NAME", "SSN" }; 
List<DataFromDB> 

Open in new window

0
I am building an entirely new web service with Node and am seriously considering using mongoDB instead of MySQL.

I will be using the Sails.js framework, which includes Waterline for the ORM. I presume Waterline expo its the benefits of going direct to/from JSON and not requiring SQL. Please let me know about that...


What are the Pros of switching to mongoDB?

The Cons?
0
We are running Redis on our iSeries.  To start Redis, I have to do the following:

CALL QP2TERM
CD /QOPENSYS
/opt/freeware/sbin/redis-server  

When I do this, this starts the redis-server job in the QINTER subystem running under my user profile.

Does anyone know how I could write a CL to start this application under a specified subsystem using a specified user profile?

Thanks in advance
0
Hi there,

I am using mongodb client for java and I want it to be efficient.

Which "WriteConcern" is most efficient to be used?

Any help is greatly appreciated. I have done programming but it is my first time using mongodb.

Thanks,
Zizi
0
Hi,

I have a program that cannot be stopped due to business requirements. However, the program needs to reload some dictionaries if they are updated. I am thinking of using Redis to communicate between the program and the application which modify the dictionaries.

However, except for redis, what else can I do? Can I use a listener within the program to monitor whether the dictionaries are modified? If so, how to program the listener.

My program runs as a command process under Linux, and the application that modifies the dictionaries is a Java servlet.

Thanks alot.
0
I am trying to delete a bunch of records from MongoDB, but am having some issues with my JavaScript. It seems to go through the first 10 records and stop. Here is what I have so far:

function getObjectIDs() {
          var IDs = db.mycollection.find({log:{$lt:ISODate('2013-06-01T00:23:24.154Z')}}, {_id:1});
          return IDs;
}

function removeID(db, userId) {

          db.mysecondcollection.remove({user:userId});

}

var IDs = getObjectIDs();

IDs.forEach(function(ID) {
          removeID(db, ID._ID);
});

Open in new window


Can anyone see what I may be doing wrong?
0
I am not clear how to add square brackets for array in mongod and php.  Have done via console, but not in php.

  $item = array(
    'mod' => (string)"firstone",
	'pages' => array('grocersl' => array([('types'=>array('fruit'=>array('read'=>1,'write'=>2))))),
	'bannedFruits' => (string)"mandarin"]
  );

Open in new window


Which goes in like

        "_id" : ObjectId("52913262d3ff4da428000000"),
        "type" : "grocers",
        "store" : {
                "stock" : {
                        "fruit" : {
                                "apples" : {
                                        "johnathon" : 1,
                                        "grannies" : 2
                                }
                        }
                }
        },
        "makeActive" : 1
------------
I neeed to produce the following and add the square brackets, to produce the array.  Adding the square brackets is the only bit i have difficulty with.

_id" : ObjectId("52913262d3ff4da428000000"),
        "type" : "grocers",
        "store" : {
                "stock" : {
                        "fruit" :[
                                     {
                                   "apples" : {
                                        "johnathon" : 1,
                                        "grannies" : 2
                                    },
                                     {
                                   "oranges" : {
                                        "sweet" : 1,
                                        "grannies" : 2
                                    }
                              ],
                        }
                }
        },
        "makeActive" : 1
0
It would be better if I started from the top.

We have an old but very robust Visual Foxpro 9 application. It is an ERP system for Truck Brokerage firms. Well this application has been out for 14 years and was the first windows based brokerage software. Obviously it has gone through a lot of changes in the last 14 years. It currently handles all accounting, interfaces with quickbooks, creates invoices, rate confirmations, email, pdf conversion, document management, and a lot of other functions for the truck brokerage companies.

Because it is currently just a server/client appliation and almost everything is moving to web-based applications, 2 and a half years ago we began rewriting the Visual Foxpro application to a web based application using PHP, AJAX, JSON, JQuery, and a MySQL database.

That wasn't the only reason for the application to be rewritten, the current application has been through many programmers hands in the last 14 years and has some poorly coded methods and practices throughout the program. Also Microsoft will no longer be supporting VFP9 for much longer. Yes it will continue to work fine but when Microsoft stops supporting an applications you have to worry about hot fixes, or at least that has been my experience in the past.

Anyway back to the application and the rewrite, the person in charge of creating the spec sheet for the web-based application really just skimmed the surface of the Visual Foxpro application.

We only have had one developer coding…
0
I am looking for any script or opensource tool that will dump mongodb performance , like query execution(Insert, update, delete) and any/every other operation on mongodb and dump statistics for them into a log file. I am trying to collect these log files and analyse them using splunk.

Any help in this matter is greatly appreciated.
0
One of the apps that I am researching as a possible project, will be a database application that allows clients to access the data on a hosted platform.  We will initially be using a C# Desktop front-end, but I could really do with some additional advice as to the back-end.  We will be seeking professional guidance on this - but I would really like a little heads-up first.

The type of application means that each client could have multiple, individual databases of between 1k and 10k records (average), which although are initially based on a standard template are slightly altered for each project (there could be in excess of 100 projects (although not all will be used at the same time)).  Also, there could be up to 50 users (working on the various projects).  In addition to this, the aim will be to get multiple clients....who may need the same type of setup.

So my question is - would you initially have one instance of a server such as Microsoft SQL / PostgreSQL (other suggestions greatly appreciated) for all of the clients, or would you need to set-up a separate instance/server for each one?

As mentioned, we will be seeking help on this - I'd just also like some EE help first.

Thank you.
0
Hi,
we currently use Oracle as the database for our php/apache based web applications and we heard that oracle is not the best database for web applications.

What is the best database for web application?

Thanks,

Luchuan
1
How to count the no of rows in columnfamily in cassandra using cli command
0

NoSQL Databases

182

Solutions

337

Contributors

A NoSQL database provides a mechanism for storage and retrieval of data which is modeled in means other than the tabular relations used in relational databases. Motivations for this approach include: simplicity of design, simpler "horizontal" scaling to clusters of machines and finer control over availability. The data structures used by NoSQL databases (e.g. key-value, wide column, graph, or document) are specified from those used by default in relational databases, making some operations faster in NoSQL. Sometimes the data structures used by NoSQL databases are also viewed as "more flexible" than relational database tables.

Top Experts In
NoSQL Databases
<
Monthly
>