[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x

Percona

Percona is the only company that delivers enterprise-class software, support, consulting and managed services solutions for both MySQL® and MongoDB® across traditional and cloud-based platforms that maximize application performance while streamlining database efficiencies. Our global 24x7x365 consulting team has worked with over 3,000 clients worldwide, including the largest companies on the Internet, who use MySQL, Percona Server, Amazon® RDS for MySQL, MariaDB® and MongoDB.

Percona consultants have decades of experience solving complex database and database performance issues and design challenges. We consult on the full LAMP stack, from hardware to operating systems and right up through the database and web tiers. Because we are both broadly and deeply experienced, we can help build complete solutions. Our consultants work both remotely and on site. We can also provide full-time or part-time interim staff to cover employee absences or provide extra help on big projects.

Percona was founded in August 2006 by Peter Zaitsev and Vadim Tkachenko and now employs a global network of experts with a staff of over 125 people. Our customer list is large and diverse and we have one of the highest renewal rates in the business. Our expertise is visible in our widely read Percona Database Performance blog (https://www.percona.com/blog) and our book High Performance MySQL. To put Percona's expertise to work for you, please contact us (https://www.percona.com/about-percona/contact).

Share tech news, updates, or what's on your mind.

Sign up to Post

MySQL - Percona Edition.

Full table scan is taking over 1 second and crashing our backend servers, the table has about 1.2 million records, if the IP is located then it returns very quickly and has no issues, eventually we hit max connections on the server if it can't find it as it does a full table scan. This server is beefy, 128GB of ram + 800GB SSD and dual hexacore processors

SELECT *
  FROM geoip_proxy_ipv4_09_2018
  WHERE INET_ATON('192.168.0.1') BETWEEN ip_from AND ip_to
  LIMIT 1

Open in new window


The table structure is this:
CREATE TABLE IF NOT EXISTS `geoip_proxy_ipv4_09_2018` (
  `ip_from` decimal(10,0) NOT NULL,
  `ip_to` decimal(10,0) NOT NULL,
  `proxy_type` varchar(3) NOT NULL,
  `country_code` varchar(2) NOT NULL,
  `country_name` varchar(128) NOT NULL,
  `region_name` varchar(128) NOT NULL,
  `city_name` varchar(128) NOT NULL,
  UNIQUE KEY `idx_ip_from_ip_to` (`ip_from`,`ip_to`),
  KEY `ip_to` (`ip_to`),
  KEY `ip_from` (`ip_from`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1;

Open in new window


These are the indexes:
Indexes
Keyname	Type	Unique	Packed	Column	Cardinality	Collation	Null	Comment
idx_ip_from_ip_to	BTREE	Yes	No	ip_from	1254839	A	No	
ip_to	1254839	A	No
ip_to	BTREE	No	No	ip_to	1254839	A	No	
ip_from	BTREE	No	No	ip_from	1254839	A	No	

Open in new window


If we do 800 requests per second (lookups) our database server and our backend servers max out their connections waiting for response from backend server... thoughts?
0
Powerful Yet Easy-to-Use Network Monitoring
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

Need to make our MySQL queries faster on a large table (1544980 total records)

SELECT id,sender,recipient,message,priority,flash_message
FROM movistar_mt3_saca_nic
WHERE process=0
ORDER BY priority DESC, id ASC
LIMIT 10

Open in new window


its a transactional table, we select 10 numbers and try to bill them within 1 second for services and then they get updated with the bill status so they dont get billed twice...
a timer then selects another set of 10 numbers... the query is taking 3.5seconds...

the structure of the table is this:

CREATE TABLE IF NOT EXISTS `movistar_mt3_saca_nic` (
  `id` bigint(14) NOT NULL AUTO_INCREMENT,
  `batch_id` varchar(20) NOT NULL,
  `sender` varchar(50) NOT NULL,
  `recipient` varchar(50) NOT NULL,
  `message` varchar(180) NOT NULL,
  `sequence_number` int(11) NOT NULL DEFAULT '0',
  `command_status` varchar(11) DEFAULT NULL,
  `message_id` varchar(255) DEFAULT NULL,
  `done_date` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP,
  `service` bigint(14) DEFAULT NULL,
  `send_time` datetime(3) DEFAULT NULL,
  `confirm_time` datetime(3) DEFAULT NULL,
  `sequence_sending` int(11) NOT NULL DEFAULT '1',
  `process` int(11) NOT NULL DEFAULT '0',
  `priority` int(11) NOT NULL DEFAULT '0',
  `flash_message` int(11) NOT NULL DEFAULT '0',
  `transaction_id` varchar(50) DEFAULT NULL,
  `delivery_number` int(11) DEFAULT '1',
  `part_number` int(11) DEFAULT '1',
  `qty_attempts` int(11) DEFAULT '0',
  `product_id` varchar(50) DEFAULT NULL,
  PRIMARY 

Open in new window

0
We have to serve 50,000,000,000 requests per day, our app can handle that, but we're not sure if our database skills are there to pick this up. We have a database server with 256gb of ram and 512GB SSD RAID using percona edition. Some of the data needs to stay on the database for 30 days, the transaction table where all requests are stored. what approach do we need to scale this horizontally? each endpoint requests runs about 4 queries...
0
Task availableI have found that this Dell PowerEdge T110 II that has two disks with Raid 1 configuration seems that one of the disk has failed. I have screen shots that I took from OpenManage Server Configuration for you to review. I believe that Disk 0:1 is the one has failed and I must first assigned it to be Global Hot spare and then re create the Raid1. Please review the attached file and advise if this is how I have to do it either from here or from Raid Bios.

Regards,
Change 2009
Fig-1
Storage Dashboard

Fig-2
Health
Fig-3
Connector
Fig-4
Task available
Fig-5

Task available4--Physical-Disks-On-PERC-S100.JPG
0
Dear Experts,

I deploy a Database System using Percona XtraDB ver.5.7 (3 Nodes) and 1 HaProxy as DB Load Balancer with Read/Write splitting config. Write on 1 Node, 2 nodes remain is back up. And Read will load balance between 3 nodes.
All 3 Node have 6CPU, 16GB RAM, and run on a local network.

My issue is when run queries, specially alter query, Node Write become conflict and cannot select data.
Percona Log:

2017-12-30T11:23:36.595013Z 624933 [Note] WSREP: --------- CONFLICT DETECTED --------
2017-12-30T11:23:36.595128Z 624933 [Note] WSREP: cluster conflict due to high priority abort for threads:

2017-12-30T11:23:36.595143Z 624933 [Note] WSREP: Winning thread: 
   THD: 624933, mode: total order, state: executing, conflict: no conflict, seqno: 2819156
   SQL: ALTER TABLE `sales_flat_order_address` ADD INDEX (`address_type`)

2017-12-30T11:23:36.595157Z 624933 [Note] WSREP: Victim thread: 
   THD: 630854, mode: local, state: executing, conflict: no conflict, seqno: -1
   SQL: SELECT `main_table`.*, COUNT(*) as count_item, ( SUM(main_table.row_total_incl_tax) + IFNULL( sfois.shipping_amount, 0 ) ) AS `sum_row_total_incl_tax`, `sfo`.`increment_id` AS `order_increment_id`, `sfo`.`delivery_date`, `sfo`.`delivery_time`, `sfo`.`entity_id` AS `order_id`, `sfo`.`increment_id` AS `order_increment_id`, CONCAT(sfoas.street, ' ', sfoas.city) AS `s_address`, CONCAT(sfoas.firstname, ' ', sfoas.lastname) AS `s_fullname`, `sfoas`.`telephone` AS `s_telephone`, 

Open in new window

0
MySQL Hot backup for 60GB database.

First I've read that mysql dump is can be slower than another enterprise app so that is where I'm exploring now.  
Trying to find a solution for a hot backup of a 60GB database.  It needs to be encrypted because of sensitive data so looking for the software to use, commands, and tips.

MySQL Enterprise Backup - Is what I'm looking at 30 day free trial but cannot find how much it cost?
If I wanted this recoverable up to the closet time like 15 minutes/1hour how can that be acomplished?  Which command?

I've also seen Percona XtraBackup 2.4.8 but seems to be Linux based and I would have to spin up and pay for another Linux server.  I know the db is small but the nightly backups we take would be bad if I could recover 23 hours ago.  I need a smaller window.  

Also since the DB is so small is it faster to backup to same server and then have an ftp script send or copy it somewhere else.
The fear is with this application it says there are reasons for a table to become corrupt.  So  I also won't know the time it does become corrupt is backing up every hour or every change just going to overwrite that?  How do I achoomplish the simple goal of Daister Recovery up to the minute of incident.  If it is a corrupt table or an entire database that needs to be restored for some reasons.
0
In this blog post, we’ll look at how using thread_statistics can cause high memory usage.
0
In this blog, we’ll look at how improvements to Percona XtraDB Cluster improved IST performance.
0
Some Basic Differences Between MySQL and MongoDB
In this video, Percona Solutions Engineer Barrett Chambers discusses some of the basic syntax differences between MySQL and MongoDB.

To learn more check out our webinar on MongoDB administration for MySQL DBA: https://www.percona.com/resources/webinars/mongodb-administration-mysql-dba
0

Expert Comment

by:Globalnetech India
Nice Article and thanks for sharing information
0
How Do You Implement High Availability in a Database Environment?
In this video, Percona Solution Engineer Rick Golba discuss how (and why) you implement high availability in a database environment.

To discuss how Percona Consulting can help with your design and architecture needs for your database and infrastructure, please call us at +1-888-316-9775 (USA), +44 203 608 6727 (Europe), or have us contact you (http://learn.percona.com/contact-me)
0
Making Bulk Changes to Active Directory
LVL 8
Making Bulk Changes to Active Directory

Watch this video to see how easy it is to make mass changes to Active Directory from an external text file without using complicated scripts.

Percona Server for MongoDB
In this video, Percona Director of Solution Engineering Jon Tobin discusses the function and features of Percona Server for MongoDB.


How Percona can help

Percona can help you determine if Percona Server for MongoDB is the right solution for your company and if it is, help with your deployment, while ensuring optimal performance. Enterprise-class Percona Support is available 24/7 to answer all your questions, ensure your deployment runs as expected, and help you in a crisis.

To discuss how Percona can help you make your Percona Server for MongoDB deployment a success, please call us at +1-888-316-9775 (USA), +44 203 608 6727 (Europe), or have us contact you (http://learn.percona.com/contact-me).
0
Why Use Three Nodes in a Database Cluster?
In this video, Percona Solution Engineer Dimitri Vanoverbeke discusses why you want to use at least three nodes in a database cluster.

To discuss how Percona Consulting can help with your design and architecture needs for your database and infrastructure, please call us at +1-888-316-9775 (USA), +44 203 608 6727 (Europe), or have us contact you: http://learn.percona.com/contact-me
0
In this article, we’ll look at how to deploy ProxySQL.
0
In this article, I’ll talk about multi-threaded slave statistics printed in MySQL error log file.
1
Backups and Disaster RecoveryIn this post, we’ll look at strategies for backups and disaster recovery.
1
In this article, I’ll look at how you can use a backup to start a secondary instance for MongoDB.
0
By, Vadim Tkachenko. In this article we’ll look at ClickHouse on its one year anniversary.
2
In this blog post, we’ll look at how ClickHouse performs in a general analytical workload using the star schema benchmark test.
1
Percona XtraDB Cluster, Galera Cluster, MySQL Group Replication Join Percona’s MySQL Practice Manager Kenny Gryp and QA Engineer, Ramesh Sivaraman as they present Percona XtraDB Cluster, Galera Cluster, MySQL Group Replication on Wednesday, June 21, 2017 at 10:00 am PDT / 1:00 pm EDT (UTC-7).  Register here: http://hubs.ly/H07QMYT0

What are the implementation differences between Percona XtraDB Cluster 5.7, Galera Cluster 5.7 and MySQL Group Replication?

    How do each of these work?
    How do they behave differently?
    Do these methods have any major issues?

This webinar will describe the differences and shed some light on how QA is done for each of the different technologies. Register here: http://hubs.ly/H07QMYT0
Percona-XtraDB-Cluster-certification.png
0
IT Pros Agree: AI and Machine Learning Key
LVL 1
IT Pros Agree: AI and Machine Learning Key

We’d all like to think our company’s data is well protected, but when you ask IT professionals they admit the data probably is not as safe as it could be.

Webinar - Percona Software News and Roadmap Update
Come and listen to Percona CEO Peter Zaitsev discuss what’s new in Percona open source software, including Percona Server for MySQL and MongoDB, Percona XtraBackup, Percona Toolkit, Percona XtraDB Cluster and Percona Monitoring and Management.

During this webinar Peter will talk about newly released features in Percona software, show a few quick demos and share with you highlights from the Percona open source software roadmap.

Peter will also talk about new developments in Percona commercial services and finish with a Q&A.

Want to get weekly updates on the latest Percona updates, trends in open source, and more? Subscribe now and we'll send you an update every Friday at 1pm ET.
0
Webinar - Best Practices Migrating to Open Source Databases
This is a high-level webinar that covers the history of enterprise open source database use. It addresses both the advantages companies see in using open source database technologies, as well as the fears and reservations they might have.

In this webinar, we will look at how to address such concerns to help get a migration commitment. We’ll cover picking the right project, selecting the right organizational team to manage migration, and developing the right migration path to maximize migration success (from a technical and organizational standpoint).

If you enjoyed this video please check out more videos from Percona here. To see a list of upcoming webinars you can visit our webinar page here to sign up.

Want to get weekly updates from Percona? Subscribe now and we'll send you an update every Friday at 1pm ET.
0
This post looks at MongoDB and MySQL, and covers high-level MongoDB strengths, weaknesses, features, and uses from the perspective of an SQL user.
0
In this series, we will discuss common questions received as a database Solutions Engineer at Percona. In this role, we speak with a wide array of MySQL and MongoDB users responsible for both extremely large and complex environments to smaller single-server environments.
0
This post contains step-by-step instructions for setting up alerting in Percona Monitoring and Management (PMM) using Grafana.
0
Recently I was talking with Tim Sharp, one of my colleagues from our Technical Account Manager team about MongoDB’s scalability. While doing some quick training with some of the Percona team, Tim brought something to my attention...
0

Percona

Percona is the only company that delivers enterprise-class software, support, consulting and managed services solutions for both MySQL® and MongoDB® across traditional and cloud-based platforms that maximize application performance while streamlining database efficiencies. Our global 24x7x365 consulting team has worked with over 3,000 clients worldwide, including the largest companies on the Internet, who use MySQL, Percona Server, Amazon® RDS for MySQL, MariaDB® and MongoDB.

Percona consultants have decades of experience solving complex database and database performance issues and design challenges. We consult on the full LAMP stack, from hardware to operating systems and right up through the database and web tiers. Because we are both broadly and deeply experienced, we can help build complete solutions. Our consultants work both remotely and on site. We can also provide full-time or part-time interim staff to cover employee absences or provide extra help on big projects.

Percona was founded in August 2006 by Peter Zaitsev and Vadim Tkachenko and now employs a global network of experts with a staff of over 125 people. Our customer list is large and diverse and we have one of the highest renewal rates in the business. Our expertise is visible in our widely read Percona Database Performance blog (https://www.percona.com/blog) and our book High Performance MySQL. To put Percona's expertise to work for you, please contact us (https://www.percona.com/about-percona/contact).

Top Experts In
Percona
<
Monthly
>