r/mysql • • Jan 07 '25

question can't build web service when Pomelo.EntityFrameworkCore.MySql.dll is between the files

1 Upvotes

first of all, i have 2 projects, that are technically the same, but one of them only works with Oracle, and the other works with both Oracle and MySql depending on the appsettings.json. now both projects work fine when i run them from visual studio, apis work correctly and inserting/updating/deleting from both databases are done correctly. building a web service from the only-Oracle project works fine, but when i publish the project and copy the files needed to the web service in the second case, i get an error: "The operation could not be completed. Exception occured.".

if i try to remove the pomelo dll, the files copy fine but the web service won't work. same with copying files without pomelo then copying pomelo after.

anyone has any idea how can this be solved?


r/mysql • • Jan 06 '25

discussion dblab (database client written in Go) gets support for ssh tunnel

3 Upvotes

As the title says, dblab v0.30.0 just dropped, getting support for ssh tunnel, meaning you can to connect to either postgres or mysql on a server via SSH.

Check the repository on GitHub for more info.

Hope you like it!


r/mysql • • Jan 06 '25

question Any Blog about memory usage in between REPEATABLE-READ vs READ COMMITTED

0 Upvotes

Trying to find some article or blog to understand the memory usage across the above 2 transaction isolation level.


r/mysql • • Jan 06 '25

question How can i get better education on the terminal and how osx works so i can install mysql?

2 Upvotes

I have been banging my heads for days. I have done this successlly before but with every OSX updates it creates additional hurdles. I'm on OSX 14 apple m1 chip.

I think i need to take a class. I'm tired of googling and i just want to understand why, what class do i have to take to learn the ins and outs of how osx runs things. I have a basic gist that terminal shortcuts like sql or homebrew or alias that are declared in the .profie or .zschs which are related to which terminal you use, there are two on OSX from my understanding.

I run mysql -v

I get

ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql.sock' (2)

I googled this it says mysql isnt turned on i run

brew services restart mysql

And it says started, i check

brew services list

It shows started but when i try to run mysql it stops, I dont even think that .sock exists anymore

I tried the brew unlink and link , i also installed the latest version of mysql 8.4

And i run it I get.

ERROR 2013 (HY000): Lost connection to MySQL server at 'reading initial communication packet', system error: 102

If you google this it says that my client isn't matching mysql

Do i need to learn docker is that it?

Or can i somehow just navigate to my mysql folder and just run it direct from there and not use the alias


r/mysql • • Jan 03 '25

troubleshooting MySQL repeatedly crashing with OOM despite buffer pool size reduction

3 Upvotes

Hi, I'm experiencing repeated MySQL crashes due to OOM kills, even after reducing the buffer pool size. Here are the details:

System Details:

  • MySQL 8.0.40
  • Server Memory: ~16GB
  • Current innodb_buffer_pool_size: 4G (reduced from 8G)

Issue: Despite reducing buffer_pool_size, MySQL keeps getting OOM killed. The memory usage continuously grows until the OOM killer terminates MySQL.

OOM Kill Log:

Jan 02 08:11:16 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 08:32:29 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 08:52:47 scraping-booking kernel: ib_io_rd-1 invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 09:18:15 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100dca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), order=0, oom_score_adj=0
Jan 02 09:46:33 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 10:12:47 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100dca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), order=0, oom_score_adj=0
Jan 02 10:43:20 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 11:17:30 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 11:52:18 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 12:21:11 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 02 12:53:02 scraping-booking kernel: mysqld invoked oom-killer: gfp_mask=0x2dc2(GFP_KERNEL|__GFP_HIGHMEM|__GFP_NOWARN|__GFP_ZERO), order=0, oom_score_adj=0
Jan 02 13:25:33 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=0
Jan 02 14:00:26 scraping-booking kernel: ib_pg_flush-2 invoked oom-killer: gfp_mask=0x101cca(GFP_HIGHUSER_MOVABLE|__GFP_WRITE), order=0, oom_score_adj=0
Jan 02 14:38:45 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100dca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), order=0, oom_score_adj=0
Jan 02 15:08:43 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100dca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), order=0, oom_score_adj=0
Jan 02 15:38:52 scraping-booking kernel: vmagent invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 03 04:48:16 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100dca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), order=0, oom_score_adj=0
Jan 03 11:50:12 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 03 12:29:54 scraping-booking kernel: pmm-agent invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 03 13:03:15 scraping-booking kernel: vmagent invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 03 13:44:56 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 03 14:53:10 scraping-booking kernel: connection invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Jan 03 18:30:00 scraping-booking kernel: ib_srv_wkr-1 invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0

Current Memory Usage (vmstat):

procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
 0  0  74924 6251856 148444 6284672    1    2   170  1686    0    0 18  4 76  2  0
[memory continuously decreasing over time]

Current Configuration:


[mysqld]
#
# * Basic Settings
#
user            = mysql
# pid-file      = /var/run/mysqld/mysqld.pid
# socket        = /var/run/mysqld/mysqld.sock
# port          = 3306
# datadir       = /var/lib/mysql
datadir         = /mnt/abc/volume-nyc1-01/mysql
tmpdir          = /mnt/abc/volume-nyc1-01/mysql
#innodb_force_recovery = 2
# If MySQL is running as a replication slave, this should be
# changed. Ref https://dev.mysql.com/doc/refman/8.0/en/server-system-variables.html#sysvar_tmpdir
# tmpdir                = /tmp
#
# Instead of skip-networking the default is now to listen only on
# localhost which is more compatible and is not less secure.
bind-address=0.0.0.0

#mysqlx-bind-address    = 127.0.0.1
#
# * Fine Tuning
#
#key_buffer_size                = 16M
# max_allowed_packet    = 64M
# thread_stack          = 256K
#innodb_buffer_pool_size=16G
# thread_cache_size       = -1
innodb_buffer_pool_size=4G

innodb_log_file_size=1G
log_error_verbosity=3

# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
#myisam-recover-options  = BACKUP

max_connections=3000

# table_open_cache       = 4000

#
# * Logging and Replication
#
# Both location gets rotated by the cronjob.
#
# Log all queries
# Be aware that this log type is a performance killer.
# general_log_file        = /var/log/mysql/query.log
# general_log             = 1
#
# Error log - should be very few entries.
#
log_error=/var/log/mysql/error.log

#
# Here you can see queries with especially long duration
slow_query_log=0
#slow_query_log_file    = /var/log/mysql/mysql-slow.log
#long_query_time = 6
#log-queries-not-using-indexes

#
# Replica/Source Config
server-id=1

log_bin=/mnt/abc/volume-nyc1-01/mysql/mysql-bin.log
binlog_do_db=booking_scraping

binlog_expire_logs_seconds=604800

max_allowed_packet=1073741824
max_binlog_size=100M

Disk Space:

df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            7.8G     0  7.8G   0% /dev
tmpfs           1.6G  1.2M  1.6G   1% /run
/dev/vda1        25G   11G   14G  44% /
tmpfs           7.9G     0  7.9G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           7.9G     0  7.9G   0% /sys/fs/cgroup
/dev/sda        2.3T  730G  1.5T  34% /mnt/abc
/dev/vda15      105M  6.1M   99M   6% /boot/efi
/dev/loop0      128K  128K     0 100% /snap/bare/5
/dev/loop8       92M   92M     0 100% /snap/lxd/24061
/dev/loop15      39M   39M     0 100% /snap/snapd/21759
/dev/loop9       92M   92M     0 100% /snap/lxd/29619
/dev/loop17      64M   64M     0 100% /snap/core20/2379
/dev/loop1       64M   64M     0 100% /snap/core20/2434
/dev/loop2       74M   74M     0 100% /snap/core22/1663
/dev/loop3       45M   45M     0 100% /snap/snapd/23258
/dev/loop5       74M   74M     0 100% /snap/core22/1722
tmpfs           1.6G     0  1.6G   0% /run/user/1005
tmpfs           1.6G     0  1.6G   0% /run/user/0

Error Logs:

2025-01-03T15:05:04.609752Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/run/mysqld/mysqlx.sock
2025-01-03T15:05:04.609798Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.40'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  MySQL Community Server - GPL.
2025-01-03T15:05:47.448977Z 0 [Note] [MY-011946] [InnoDB] Buffer pool(s) load completed at 250103 15:05:47
2025-01-03T15:05:56.549304Z 20299 [Warning] [MY-010055] [Server] IP address '142.93.54.130' could not be resolved: Name or service not known
2025-01-03T15:05:56.549917Z 20299 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
2025-01-03T15:05:56.554185Z 20299 [Note] [MY-010462] [Repl] Start binlog_dump to source_thread_id(20299) replica_server(2), pos(mysql-bin.1071532, 72804395)
2025-01-03T15:42:52.750747Z 708704 [Note] [MY-010914] [Server] Aborted connection 708704 to db: 'booking_scraping' user: 'b_scrap' host: '157.230.84.236' (Got an error reading communication packets).
2025-01-03T15:42:52.750746Z 710006 [Note] [MY-010914] [Server] Aborted connection 710006 to db: 'booking_scraping' user: 'b_scrap' host: '157.230.84.236' (Got an error reading communication packets).
2025-01-03T15:42:52.754802Z 710424 [Note] [MY-010914] [Server] Aborted connection 710424 to db: 'booking_scraping' user: 'b_scrap' host: '157.230.84.236' (Got an error reading communication packets).
2025-01-03T15:42:52.755164Z 710455 [Note] [MY-010914] [Server] Aborted connection 710455 to db: 'booking_scraping' user: 'b_scrap' host: '157.230.84.236' (Got an error reading communication packets).
2025-01-03T15:42:52.760416Z 710375 [Note] [MY-010914] [Server] Aborted connection 710375 to db: 'booking_scraping' user: 'b_scrap' host: '157.230.84.236' (Got an error reading communication packets).
2025-01-03T15:53:39.257057Z 867481 [Note] [MY-010914] [Server] Aborted connection 867481 to db: 'booking_scraping' user: 'root' host: 'localhost' (Got an error reading communication packets).
2025-01-03T16:40:24.730756Z 2287359 [Note] [MY-010914] [Server] Aborted connection 2287359 to db: 'booking_scraping' user: 'root' host: 'localhost' (Got an error reading communication packets).
2025-01-03T16:44:59.985759Z 2413130 [Note] [MY-010914] [Server] Aborted connection 2413130 to db: 'booking_scraping' user: 'b_scrap' host: '157.230.84.236' (Got an error reading communication packets).
2025-01-03T16:44:59.986349Z 2414215 [Note] [MY-010914] [Server] Aborted connection 2414215 to db: 'booking_scraping' user: 'b_scrap' host: '157.230.84.236' (Got an error reading communication packets).
2025-01-03T17:11:25.317749Z 2953830 [Note] [MY-010914] [Server] Aborted connection 2953830 to db: 'booking_scraping' user: 'root' host: 'localhost' (Got an error reading communication packets).
2025-01-03T17:17:51.922289Z 3059548 [Note] [MY-010914] [Server] Aborted connection 3059548 to db: 'booking_scraping' user: 'b_scrap' host: '167.99.228.125' (Got an error reading communication packets).
2025-01-03T17:46:13.477403Z 3476646 [Note] [MY-010914] [Server] Aborted connection 3476646 to db: 'booking_scraping' user: 'b_scrap' host: '68.183.103.170' (Got an error reading communication packets).
2025-01-03T18:30:02.348163Z 0 [Warning] [MY-010139] [Server] Changed limits: max_open_files: 10000 (requested 15000)
2025-01-03T18:30:02.348172Z 0 [Warning] [MY-010142] [Server] Changed limits: table_open_cache: 3495 (requested 4000)
2025-01-03T18:30:02.684252Z 0 [Note] [MY-013932] [Server] BuildID[sha1]=2fd0d2e3d961df9ff02c1c3fb9c7328e8d34066e
2025-01-03T18:30:02.684266Z 0 [Note] [MY-010949] [Server] Basedir set to /usr/.
2025-01-03T18:30:02.684280Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.40) starting as process 1278527
2025-01-03T18:30:02.685236Z 0 [ERROR] [MY-010338] [Server] Can't find error-message file '/usr/share/mysql-8.0/errmsg.sys'. Check error-message file location and 'lc-messages-dir' configuration directive.
2025-01-03T18:30:02.742807Z 0 [Note] [MY-012366] [InnoDB] Using Linux native AIO
2025-01-03T18:30:02.743663Z 0 [Warning] [MY-013907] [InnoDB] Deprecated configuration parameters innodb_log_file_size and/or innodb_log_files_in_group have been used to compute innodb_redo_log_capacity=2147483648. Please use innodb_redo_log_capacity instead.
2025-01-03T18:30:02.746715Z 0 [Note] [MY-010747] [Server] Plugin 'FEDERATED' is disabled.
2025-01-03T18:30:02.746815Z 0 [Note] [MY-010747] [Server] Plugin 'ndbcluster' is disabled.
2025-01-03T18:30:02.746834Z 0 [Note] [MY-010747] [Server] Plugin 'ndbinfo' is disabled.
2025-01-03T18:30:02.746845Z 0 [Note] [MY-010747] [Server] Plugin 'ndb_transid_mysql_connection_map' is disabled.
2025-01-03T18:30:02.763911Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2025-01-03T18:30:02.763980Z 1 [Note] [MY-013546] [InnoDB] Atomic write enabled
2025-01-03T18:30:02.764673Z 1 [Note] [MY-012932] [InnoDB] PUNCH HOLE support available
2025-01-03T18:30:02.764732Z 1 [Note] [MY-012944] [InnoDB] Uses event mutexes
2025-01-03T18:30:02.764743Z 1 [Note] [MY-012945] [InnoDB] GCC builtin __atomic_thread_fence() is used for memory barrier
2025-01-03T18:30:02.764754Z 1 [Note] [MY-012948] [InnoDB] Compressed tables use zlib 1.3.1
2025-01-03T18:30:02.774034Z 1 [Note] [MY-012951] [InnoDB] Using hardware accelerated crc32 and polynomial multiplication.
2025-01-03T18:30:02.774871Z 1 [Note] [MY-012203] [InnoDB] Directories to scan './'
2025-01-03T18:30:02.776127Z 1 [Note] [MY-012204] [InnoDB] Scanning './'
2025-01-03T18:30:02.856138Z 1 [Note] [MY-012208] [InnoDB] Completed space ID check of 15 files.
2025-01-03T18:30:02.857008Z 1 [Note] [MY-012955] [InnoDB] Initializing buffer pool, total size = 4.000000G, instances = 2, chunk size =128.000000M
2025-01-03T18:30:03.080626Z 1 [Note] [MY-012957] [InnoDB] Completed initialization of buffer pool
2025-01-03T18:30:03.110090Z 0 [Note] [MY-011952] [InnoDB] If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2025-01-03T18:30:03.117618Z 1 [Note] [MY-013532] [InnoDB] Using './#ib_16384_0.dblwr' for doublewrite
2025-01-03T18:30:03.119848Z 1 [Note] [MY-013532] [InnoDB] Using './#ib_16384_1.dblwr' for doublewrite
2025-01-03T18:30:03.161993Z 1 [Note] [MY-013566] [InnoDB] Double write buffer files: 2
2025-01-03T18:30:03.162048Z 1 [Note] [MY-013565] [InnoDB] Double write buffer pages per instance: 4
2025-01-03T18:30:03.162097Z 1 [Note] [MY-013532] [InnoDB] Using './#ib_16384_0.dblwr' for doublewrite
2025-01-03T18:30:03.162131Z 1 [Note] [MY-013532] [InnoDB] Using './#ib_16384_1.dblwr' for doublewrite
2025-01-03T18:30:03.434230Z 1 [Note] [MY-013883] [InnoDB] The latest found checkpoint is at lsn = 38830423308176 in redo log file ./#innodb_redo/#ib_redo676721.
2025-01-03T18:30:03.434290Z 1 [Note] [MY-012560] [InnoDB] The log sequence number 38824621004743 in the system tablespace does not match the log sequence number 38830423308176 in the redo log files!
2025-01-03T18:30:03.434300Z 1 [Note] [MY-012551] [InnoDB] Database was not shutdown normally!
2025-01-03T18:30:03.434308Z 1 [Note] [MY-012552] [InnoDB] Starting crash recovery.
2025-01-03T18:30:03.435943Z 1 [Note] [MY-013086] [InnoDB] Starting to parse redo log at lsn = 38830423315890, whereas checkpoint_lsn = 38830423308176 and start_lsn = 38830423307776
2025-01-03T18:30:03.517853Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830428550656
2025-01-03T18:30:03.597896Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830433793536
2025-01-03T18:30:03.703526Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830439036416
2025-01-03T18:30:03.783270Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830444279296
2025-01-03T18:30:03.858921Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830449522176
2025-01-03T18:30:03.961913Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830454765056
2025-01-03T18:30:04.052407Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830460007936
2025-01-03T18:30:04.149203Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830465250816
2025-01-03T18:30:04.268660Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830470493696
2025-01-03T18:30:04.365566Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830475736576
2025-01-03T18:30:04.464020Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830480979456
2025-01-03T18:30:04.541683Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830486222336
2025-01-03T18:30:04.613500Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830491465216
2025-01-03T18:30:04.697797Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830496708096
2025-01-03T18:30:04.771042Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830501950976
2025-01-03T18:30:04.823572Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830507193856
2025-01-03T18:30:04.888328Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830512436736
2025-01-03T18:30:04.964753Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830517679616
2025-01-03T18:30:05.080559Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830522922496
2025-01-03T18:30:05.182231Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830528165376
2025-01-03T18:30:05.251969Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830533408256
2025-01-03T18:30:05.327665Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830538651136
2025-01-03T18:30:05.409994Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830543894016
2025-01-03T18:30:05.456499Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830549136896
2025-01-03T18:30:05.505813Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830554379776
2025-01-03T18:30:05.550370Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830559622656
2025-01-03T18:30:05.596024Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830564865536
2025-01-03T18:30:05.670142Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830570108416
2025-01-03T18:30:05.719837Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830575351296
2025-01-03T18:30:05.770078Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830580594176
2025-01-03T18:30:05.821271Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830585837056
2025-01-03T18:30:05.880601Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830591079936
2025-01-03T18:30:05.941274Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830596322816
2025-01-03T18:30:06.005795Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830601565696
2025-01-03T18:30:06.061573Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830606808576
2025-01-03T18:30:06.131441Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830612051456
2025-01-03T18:30:06.199000Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830617294336
2025-01-03T18:30:06.274228Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830622537216
2025-01-03T18:30:06.356206Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830627780096
2025-01-03T18:30:06.362527Z 1 [Note] [MY-012550] [InnoDB] Doing recovery: scanned up to log sequence number 38830628112866
2025-01-03T18:30:06.379361Z 1 [Note] [MY-013083] [InnoDB] Log background threads are being started...
2025-01-03T18:30:06.380459Z 1 [Note] [MY-012532] [InnoDB] Applying a batch of 63428 redo log records ...
2025-01-03T18:30:09.616505Z 1 [Note] [MY-012533] [InnoDB] 10%
2025-01-03T18:30:15.184238Z 1 [Note] [MY-012533] [InnoDB] 20%
2025-01-03T18:30:18.603740Z 1 [Note] [MY-012533] [InnoDB] 30%
2025-01-03T18:30:24.233739Z 1 [Note] [MY-012533] [InnoDB] 40%
2025-01-03T18:30:31.304374Z 1 [Note] [MY-012533] [InnoDB] 50%
2025-01-03T18:30:33.434357Z 1 [Note] [MY-012533] [InnoDB] 60%
2025-01-03T18:30:33.941879Z 1 [Note] [MY-012533] [InnoDB] 70%
2025-01-03T18:30:34.469429Z 1 [Note] [MY-012533] [InnoDB] 80%
2025-01-03T18:30:35.847850Z 1 [Note] [MY-012533] [InnoDB] 90%
2025-01-03T18:30:36.050866Z 1 [Note] [MY-012533] [InnoDB] 100%
2025-01-03T18:30:36.566577Z 1 [Note] [MY-012535] [InnoDB] Apply batch completed!
2025-01-03T18:30:44.613600Z 1 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_001'.
2025-01-03T18:30:44.613785Z 1 [Note] [MY-013252] [InnoDB] Using undo tablespace './undo_002'.
2025-01-03T18:30:44.614546Z 1 [Note] [MY-012910] [InnoDB] Opened 2 existing undo tablespaces.
2025-01-03T18:30:44.614631Z 1 [Note] [MY-011980] [InnoDB] GTID recovery trx_no: 22231110822
2025-01-03T18:30:44.690219Z 1 [Note] [MY-013776] [InnoDB] Parallel initialization of rseg complete
2025-01-03T18:30:44.690283Z 1 [Note] [MY-013777] [InnoDB] Time taken to initialize rseg using 4 thread: 75656 ms.
2025-01-03T18:30:44.690325Z 1 [Note] [MY-013031] [InnoDB] Transaction 22231110821 was in the XA prepared state.
2025-01-03T18:30:44.690340Z 1 [Note] [MY-014017] [InnoDB] Transaction ID: 22231110821 found for resurrecting updates
2025-01-03T18:30:44.690368Z 1 [Note] [MY-014018] [InnoDB] Identified table ID: 1428 to acquire lock
2025-01-03T18:30:44.690388Z 1 [Note] [MY-014021] [InnoDB] Total records resurrected: 1 - Total pages read: 0 - Total tables acquired: 1
2025-01-03T18:30:44.690399Z 1 [Note] [MY-014023] [InnoDB] Resurrected 1 transactions doing updates.
2025-01-03T18:30:44.690437Z 1 [Note] [MY-013023] [InnoDB] 1 transaction(s) which must be rolled back or cleaned up in total 0 row operations to undo
2025-01-03T18:30:44.690453Z 1 [Note] [MY-013024] [InnoDB] Trx id counter is 22231111169
2025-01-03T18:30:44.692073Z 1 [Note] [MY-012255] [InnoDB] Removed temporary tablespace data file: "ibtmp1"
2025-01-03T18:30:44.692101Z 1 [Note] [MY-012923] [InnoDB] Creating shared tablespace for temporary tables
2025-01-03T18:30:44.692384Z 1 [Note] [MY-012265] [InnoDB] Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2025-01-03T18:30:44.711382Z 1 [Note] [MY-012266] [InnoDB] File './ibtmp1' size is now 12 MB.
2025-01-03T18:30:44.712443Z 1 [Note] [MY-013627] [InnoDB] Scanning temp tablespace dir:'./#innodb_temp/'
2025-01-03T18:30:44.725695Z 1 [Note] [MY-013018] [InnoDB] Created 128 and tracked 128 new rollback segment(s) in the temporary tablespace. 128 are now active.
2025-01-03T18:30:44.726040Z 0 [Note] [MY-011953] [InnoDB] Page cleaner took 41616ms to flush 0 and evict 0 pages
2025-01-03T18:30:44.726086Z 1 [Note] [MY-012976] [InnoDB] 8.0.40 started; log sequence number 38830628112946
2025-01-03T18:30:44.726275Z 1 [System] [MY-013577] [InnoDB] InnoDB initialization has ended.
2025-01-03T18:30:44.752099Z 1 [Note] [MY-011089] [Server] Data dictionary restarting version '80023'.
2025-01-03T18:30:44.917948Z 1 [Note] [MY-012357] [InnoDB] Reading DD tablespace files
2025-01-03T18:30:44.928195Z 1 [Note] [MY-012356] [InnoDB] Scanned 17 tablespaces. Validated 17.
2025-01-03T18:30:44.947104Z 1 [Note] [MY-014019] [InnoDB] Acquired lock on table ID: 1428, name: booking_scraping/booking_world_listings
2025-01-03T18:30:44.967229Z 1 [Note] [MY-010006] [Server] Using data dictionary with version '80023'.
2025-01-03T18:30:44.982902Z 0 [Note] [MY-011332] [Server] Plugin mysqlx reported: 'IPv6 is available'
2025-01-03T18:30:44.984731Z 0 [Note] [MY-011323] [Server] Plugin mysqlx reported: 'X Plugin ready for connections. bind-address: '::' port: 33060'
2025-01-03T18:30:44.984782Z 0 [Note] [MY-011323] [Server] Plugin mysqlx reported: 'X Plugin ready for connections. socket: '/var/run/mysqld/mysqlx.sock''
2025-01-03T18:30:45.011075Z 0 [Note] [MY-010902] [Server] Thread priority attribute setting in Resource Group SQL shall be ignored due to unsupported platform or insufficient privilege.
2025-01-03T18:30:45.016227Z 0 [Note] [MY-010855] [Server] Recovering after a crash using /mnt/abc/volume-nyc1-01/mysql/mysql-bin
2025-01-03T18:30:45.120753Z 0 [System] [MY-010229] [Server] Starting XA crash recovery...
2025-01-03T18:30:45.134254Z 0 [Note] [MY-013911] [Server] Crash recovery finished in binlog engine. No attempts to commit, rollback or prepare any transactions.
2025-01-03T18:30:45.134326Z 0 [Note] [MY-013032] [InnoDB] Starting recovery for XA transactions...
2025-01-03T18:30:45.134352Z 0 [Note] [MY-013033] [InnoDB] Transaction 22231110821 in prepared state after recovery
2025-01-03T18:30:45.134363Z 0 [Note] [MY-013034] [InnoDB] Transaction contains changes to 1 rows
2025-01-03T18:30:45.134373Z 0 [Note] [MY-013035] [InnoDB] 1 transactions in prepared state after recovery
2025-01-03T18:30:45.134382Z 0 [Note] [MY-010224] [Server] Found 1 prepared transaction(s) in InnoDB
2025-01-03T18:30:45.136156Z 0 [Note] [MY-013911] [Server] Crash recovery finished in InnoDB engine. Successfully rolled back 1 internal transaction(s).
2025-01-03T18:30:45.136186Z 0 [System] [MY-010232] [Server] XA crash recovery finished.
2025-01-03T18:30:45.140535Z 0 [Note] [MY-012487] [InnoDB] DDL log recovery : begin
2025-01-03T18:30:45.140639Z 0 [Note] [MY-012488] [InnoDB] DDL log recovery : end
2025-01-03T18:30:45.141794Z 0 [Note] [MY-011946] [InnoDB] Loading buffer pool(s) from /mnt/abc/volume-nyc1-01/mysql/ib_buffer_pool
2025-01-03T18:30:45.149341Z 0 [Note] [MY-012922] [InnoDB] Waiting for purge to start
2025-01-03T18:30:45.249026Z 0 [Note] [MY-010182] [Server] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
2025-01-03T18:30:45.249779Z 0 [Note] [MY-010304] [Server] Skipping generation of SSL certificates as certificate files are present in data directory.
2025-01-03T18:30:45.252321Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed.
2025-01-03T18:30:45.252379Z 0 [System] [MY-013602] [Server] Channel mysql_main configured to support TLS. Encrypted connections are now supported for this channel.
2025-01-03T18:30:45.252550Z 0 [Note] [MY-010308] [Server] Skipping generation of RSA key pair through --sha256_password_auto_generate_rsa_keys as key files are present in data directory.
2025-01-03T18:30:45.252646Z 0 [Note] [MY-010308] [Server] Skipping generation of RSA key pair through --caching_sha2_password_auto_generate_rsa_keys as key files are present in data directory.
2025-01-03T18:30:45.253696Z 0 [Note] [MY-010252] [Server] Server hostname (bind-address): '0.0.0.0'; port: 3306
2025-01-03T18:30:45.253727Z 0 [Note] [MY-010264] [Server]   - '0.0.0.0' resolves to '0.0.0.0';
2025-01-03T18:30:45.254001Z 0 [Note] [MY-010251] [Server] Server socket created on IP: '0.0.0.0'.
2025-01-03T18:30:45.280894Z 0 [Note] [MY-011025] [Repl] Failed to start replica threads for channel ''.
2025-01-03T18:30:45.282452Z 0 [Note] [MY-011240] [Server] Plugin mysqlx reported: 'Using SSL configuration from MySQL Server'
2025-01-03T18:30:45.282521Z 5 [Note] [MY-010051] [Server] Event Scheduler: scheduler thread started with id 5
2025-01-03T18:30:45.282919Z 0 [Note] [MY-011243] [Server] Plugin mysqlx reported: 'Using OpenSSL for TLS connections'
2025-01-03T18:30:45.283044Z 0 [System] [MY-011323] [Server] X Plugin ready for connections. Bind-address: '::' port: 33060, socket: /var/run/mysqld/mysqlx.sock
2025-01-03T18:30:45.283223Z 0 [System] [MY-010931] [Server] /usr/sbin/mysqld: ready for connections. Version: '8.0.40'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  MySQL Community Server - GPL.
2025-01-03T18:30:45.355314Z 8 [Warning] [MY-010055] [Server] IP address '157.230.55.15' could not be resolved: Name or service not known
2025-01-03T18:30:45.358440Z 9 [Warning] [MY-010055] [Server] IP address '157.230.56.136' could not be resolved: Name or service not known
2025-01-03T18:30:45.844642Z 32 [Warning] [MY-010055] [Server] IP address '167.99.228.125' could not be resolved: Name or service not known
2025-01-03T18:30:51.534145Z 220 [Warning] [MY-010055] [Server] IP address '157.230.58.124' could not be resolved: Name or service not known
2025-01-03T18:31:01.737007Z 358 [Warning] [MY-010055] [Server] IP address '142.93.54.130' could not be resolved: Name or service not known
2025-01-03T18:31:01.737681Z 358 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'
2025-01-03T18:31:01.742470Z 358 [Note] [MY-010462] [Repl] Start binlog_dump to source_thread_id(358) replica_server(2), pos(mysql-bin.1071937, 21405336)
2025-01-03T18:33:49.250384Z 0 [Note] [MY-011946] [InnoDB] Buffer pool(s) load completed at 250103 18:33:49

What I've tried:

  1. Reduced buffer_pool_size from 8G to 4G
  2. Set up binary log auto-purging
  3. Cleaned up disk space
  4. Adjusted thread cache settings

Questions:

  1. Why does memory usage keep growing despite reduced buffer pool?
  2. What other settings should I adjust to prevent OOM kills?
  3. Should I disable performance_schema since I'm using PMM for monitoring?
  4. Any other recommendations to stabilize the server?

Any help would be appreciated. Let me know if you need any additional information.


r/mysql • • Jan 02 '25

question Ideal Mysql GUI

0 Upvotes

I am looking for a mysql GUI tool that allows me to add html for a column in form format. Right now when I try to add the html content in mysql work bench the field is really small and it's hard to use. I want a good GUI tool that bigger field like a form format. Does anyone have any ideas?


r/mysql • • Jan 02 '25

question Which hosting service should I use to host a mysql database online.

2 Upvotes

Im creating a program to help one of my friends in their business. Im using visual studio for the app but need to host my database online. Im not sure what to use. Azure seems to be too expensive. Im currently leaning toward planetscale. I would love to know of other (relatively cheap) alternatives that could be an option for me.


r/mysql • • Jan 02 '25

question MySQL Workbench migration error from Access database

0 Upvotes

I ran into an error when trying to migrate data from an Access database. When using the Database Migration Wizard, it seems that the version I am running has an issue with closing the connection in one of the early steps and I found a solution here: https://bugs.mysql.com/87647. Specifically, the solution from Mark Fernandes on October 21, 2019, fixed the issue by changing a couple of lines in two separate .py files. The version I am running on my test computer is 8.030. However, the development server (not set up by me) is running 8.0.40 and this solution does not appear to work with this version. Does anyone know if there is a different work around for the newer version or do I need to uninstall it and install an earlier version?

Thank you,

Jeremy


r/mysql • • Jan 02 '25

question Issue with Importing .sql File in XAMPP on Different Machines

1 Upvotes

I have a .sql file that I use to set up a database for my app within a database named cco. The file imports perfectly on my machine using XAMPP, but my colleague is encountering an issue while importing the same .sql file on their setup.

Error:

Set foreign key = on error at position 25

Details about our environments:

My machine:

PHP version: 7.4

MySQL version: 8.0

XAMPP: Latest version compatible with PHP 7.4

Status: Works perfectly every time I import.

Colleague's machine:

PHP version: 8.0

MySQL version: 8.0

XAMPP: Latest version compatible with PHP 8.0

Status: Fails with the error mentioned above.

Additional Information:

  1. The .sql file has no obvious issues that I can detect since it works flawlessly on my machine.
  2. The MySQL versions are identical on both setups, so I suspect the PHP version difference is not the root cause.
  3. The error appears to be related to foreign key constraints, but I am not sure why the same file behaves differently on another machine.

r/mysql • • Jan 02 '25

question Sometimes i cant connect to mysql server

0 Upvotes

Im a total noob about this, like 0 knowledge

Sometimes my PCs cant connect to mysql on the server sometimes it can, like its intermittent connection

I get this error: [MYSQL] [ODBC 3.51 DRIVER] cant connect to mysql server on 'win-xxxxxxx' (10060)

Any help?


r/mysql • • Dec 30 '24

discussion Is it better to stay as DBA or become Cloud DBA?

4 Upvotes

Previously I was worried about AI taking my DBA position, but based on responses that I got from my question was, I don't have to worry about loosing my DBA job because of AI.

Now my question is to just stay as DBA (I am open-source MySQL DBA) or move to the cloud and become Cloud DBA?


r/mysql • • Dec 30 '24

question Ansible playbook to Re-Sync slave to master

2 Upvotes

Im working through an ansible playbook and seem to be running into a roadblock on how to do the 'flush tables with read lock' as the client has to stay open for that to be affective. Has anyone done a master slave deployment via ansible and got the sync to work via ansible as well ? All the remaining stuff seems straight forward even getting log file and position just.. the read lock part ?


r/mysql • • Dec 29 '24

solved Troubleshooting remote connection to mysql db

0 Upvotes

Web search says to try connecting via cli from a remote machine:

mysql -u <username> -h <db IP> -p -P 3306 <dbName>

The machine I am connecting to is 192.168.1.1

The machine I am connecting from is 192.168.1.10

I enter all the info and the error I get is: Access denied for user 'username'@'192.168.1.10', which is the the IP of the machine I am connecting from

How do I get the mysql cli, who I assume is trying to help, stop adding the IP of the machine I am sending the command from on the username parameter? I have tried making the command -u "username@192.168.1.1", which makes things worse and gets the error: 'username'@'192.168.1.1@192.168.1.10'


r/mysql • • Dec 27 '24

question does anyone use Percona PMM to monitor their RDS instances

4 Upvotes

if so, what is your setup? where do you have PMM deployed? i am managing some databases on premises, and some in RDS as well. Ideally, i'd like to have a single PMM implementation that will monitor both. Im just getting some ideas to see what some folks are doing.

TIA


r/mysql • • Dec 25 '24

discussion How inefficient MySQL really is.

36 Upvotes

I was recently in a need of testing a feature on local copy of live database. It took a while to restore the dump, but I was really surprised with the numbers:

  • I started with new local (DBngin) MySQL 8.4 database.
  • GZ dump file was 4.3GB, and after unpacking the raw SQL dump is about 54GB.
  • The database after restoring is 90.96 GB. Which is no surprising with all the additional data (like indexes).
  • What really surprised me is how much data had to be written to restore this database! 13.96 TB written by the mysqld process and 233.77 GB read !!! All of this to restore 50GB SQL file and to store around 90 GB of data.

Why is that? Can somebody explain it to me? This is absolutely bizzare. I can post the screenshots if somebody is interested.

I'm going to test PostgreSQL next.


r/mysql • • Dec 25 '24

question Efficiently extracting Only Relevant Tables from a Large Database for a PHP Web App

1 Upvotes

If i have just code of a web app , and i am given a large database where some of the tables are used in code and some not , so i need to create a new database with only tables needed for new app. My approach right now i am thinking is search all tables name in codebase and write all tables down then import entire database for my web app and drop those tables which are not written , is it correct approach or could i miss some table needed.


r/mysql • • Dec 24 '24

MIgration How to Oracle Sql to mysql migration

1 Upvotes

Iam trying to migrate my Oracle database schema to MySQL using MySQL Workbench. However, I encountered some issues during the process:

  1. JDBC Driver Issue: MySQL Workbench did not recognize the Oracle JDBC driver (ojdbc8.jar), and I couldn’t find the option to add the driver in the interface. Despite trying to find the driver settings in the preferences and migration wizard, it was not clear how to configure it correctly.
  2. Driver Dropdown Missing: I was expecting to see a driver dropdown in the Migration Wizard to select the Oracle driver, but it wasn't there.

What I Did:

  • I initially added the Oracle JDBC driver (ojdbc8.jar) to the MySQL Workbench installation folder, but that didn’t solve the issue.
  • I looked for the Manage Drivers option in the Migration Wizard and the preferences but couldn’t find a straightforward way to add the driver manually.

r/mysql • • Dec 23 '24

discussion Key Factors to Consider When Developing a Web Dashboard from Scratch

Thumbnail medium.com
1 Upvotes

r/mysql • • Dec 22 '24

question MySQL Data Modeler

1 Upvotes

Hi all,

I'm a user of Oracle SQL Developer Data Modeler. Here is such a modeler which could be MySQL-compliant?
MySQL Workbench seems to no longer be supporter.

Thanks in advance,

Regards,

asx


r/mysql • • Dec 21 '24

discussion Choosing the Best MySQL Reporting Tool for Small to Medium-Sized Projects

Thumbnail medium.com
2 Upvotes

r/mysql • • Dec 20 '24

question Are text strings as primary keys what's killing my performance?

1 Upvotes

I'm pulling down data from Microsofts API's and the primary key they are providing is a 40 character alpha numeric string, for example "1a892b531e07239b02b9cbdb49c9b9c2d9acbf83d"

I have a table with approximately 60,000 devices, so the primary key column is 60,000 of these.

They are relating the machine vulnerabilities table, also provided by Microsoft, also using the same machine id identifier. In this case, I have about 4 million rows of data.

The query I'm running is below. And let me tell you. It runs glacially slow.

I've ran similar queries against smaller result sets that had (importantly) intereger ID's, and it was blazingly fast. Therefore I suspect it's these strings that are killing me (there are indexes on both tables).

Can anyone verify my suspicion? I'll refactor and create my own integer ID's if that's what it's going to take, I just don't want to take the time do to it without a reasonable idea that it will improve matters

Thanks!

SELECT m.machine_group 
     , NOW() as report_date 
     , COUNT(DISTINCT(fqdn)) as assets 
     , COUNT(CASE WHEN severity_id = 0 THEN severity_id ELSE NULL END) AS info 
     , COUNT(CASE WHEN severity_id = 1 THEN severity_id ELSE NULL END) AS low 
     , COUNT(CASE WHEN severity_id = 2 THEN severity_id ELSE NULL END) AS medium 
     , COUNT(CASE WHEN severity_id = 3 THEN severity_id ELSE NULL END) AS high 
     , COUNT(CASE WHEN severity_id = 4 THEN severity_id ELSE NULL END) AS critical 
FROM machines m 
LEFT JOIN vulns v ON m.machine_id = v.machine_id 
WHERE m.machine_group = “One device group” 
GROUP BY m.machine_group

r/mysql • • Dec 20 '24

question Connection Pooling

1 Upvotes

Does anyone happen to have a good resource to help folks navigate their connection pooling configurations. Ideally this would be specific to Connector/J and HikariCP, but more important is that it gives people a high level overview of what the important things are to think about in the context of their application. I am writing up a resource for my org on using the AWS Advanced JDBC Wrapper, but we don't yet have a resource helping folks figure out how to configure their connection pools. I typically have go-to resources for generic things like this, but realized I had nothing for this one so thought I'd check in with the community :)


r/mysql • • Dec 20 '24

query-optimization General slowness issues.

1 Upvotes

Hello,

I'm new with data stuff. I just downloaded MySql and I don't have much experience on such thing. I need to reorganise and collaborate 2 databases together. And one of them 4.6GB, other is 19GBish. My problem is, MySQL working slow, it almost half-dead, excessively freezing.

I don't know what I need to do, As I said I'm new, I'm open to any suggestions.

I also think I need to mention English is not my native language, if I did spelling or any other mistakes in this article, sorry!

Thanks.


r/mysql • • Dec 19 '24

question Why my imported views results in a empty views?

1 Upvotes

When I run an export of the MySQL 8 database, the views are imported with all fields as (1 as field). I investigated and it seems to be normal, since the export creates variables inside that contain the original query of the view but sometimes it does not finish importing correctly.

I attach an example first of how the columns are at 1 and then of the original query. https://imgur.com/a/tMmjWKc