You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-10 - 14:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Fri Oct 10, 2025 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
113228995630,9cyclictest0-21swapper/012:38:160
11322899410,24cyclictest0-21swapper/010:37:430
113228993634,1cyclictest192960-21sendmail-msp10:07:470
11323099355,18cyclictest2243333-21munin-node11:33:192
113228993534,1cyclictest0-21swapper/012:12:450
11322899353,30cyclictest287198-21ntpq12:02:430
113228993521,1cyclictest291047-21awk12:07:430
11322899334,21cyclictest300149-21/usr/sbin/munin12:17:400
11322899331,2cyclictest0-21swapper/009:07:490
113229993222,5cyclictest203503-21sh10:17:421
113228993218,2cyclictest0-21swapper/011:52:410
11322899311,21cyclictest0-21swapper/010:47:440
11322899308,7cyclictest171rcu_preempt07:15:210
11322899290,1cyclictest0-21swapper/011:32:510
11322899280,6cyclictest239539-21ssh11:02:400
11323099278,4cyclictest11050irq/107-eth%d09:27:392
11323099266,6cyclictest11050irq/107-eth%d11:07:162
11322999262,17cyclictest131712-21swap08:07:481
11322899261,16cyclictest178817-21awk09:47:500
11323099254,2cyclictest0-21swapper/209:53:152
113230992519,4cyclictest147464-21cut08:57:432
11322899252,7cyclictest249617-21munin-run11:15:200
11322899252,10cyclictest207179-21/usr/sbin/munin10:22:400
113228992517,1cyclictest0-21swapper/012:32:380
11322899250,4cyclictest199745-21mailstats10:12:460
11322999248,10cyclictest0-21swapper/111:32:471
11322999242,4cyclictest171rcu_preempt09:47:201
113229992414,7cyclictest133920-1kworker/1:0H08:22:501
11322899246,5cyclictest0-21swapper/012:42:420
11322899244,16cyclictest159180-21ntpq09:22:440
11322899241,2cyclictest184401-21apt-get09:55:240
11323099234,14cyclictest250213-21ssh11:15:242
11322999234,5cyclictest171rcu_preempt11:05:231
113228992313,4cyclictest607-21dbus-daemon11:10:210
11322899230,1cyclictest264939-21apt-get11:35:230
11322899230,19cyclictest273966-21/usr/sbin/munin11:47:460
11323099224,5cyclictest11050irq/107-eth%d10:17:422
11323099223,16cyclictest119297-21ntp_states07:32:432
11323099223,16cyclictest119297-21ntp_states07:32:432
11323099223,15cyclictest240511-40mandb11:03:252
113230992219,2cyclictest190220-21aten_r2power_po10:02:382
113229992216,2cyclictest0-21swapper/110:32:441
113229992211,6cyclictest0-21swapper/110:06:101
113228992221,1cyclictest0-21swapper/010:35:210
113228992213,2cyclictest306909-21sendmail-msp12:27:400
11322899220,6cyclictest130749-21aten_r2power_fr08:07:370
11323099212,5cyclictest0-21swapper/210:12:382
113230992116,3cyclictest306909-21sendmail-msp12:27:472
113230992114,3cyclictest0-21swapper/211:52:422
11322999214,12cyclictest318662-21/usr/sbin/munin12:37:411
11322999211,7cyclictest209419-21sendmail-msp10:27:441
113228992119,1cyclictest0-21swapper/009:17:390
11322899211,18cyclictest211955-21unixbench_multi10:27:510
11322899211,18cyclictest0-21swapper/009:27:500
11322899210,20cyclictest257582-21apt11:25:210
11322899210,18cyclictest0-21swapper/010:02:440
11323099204,9cyclictest297622-21apt-get12:15:222
113230992016,2cyclictest170326-21cut09:37:392
11322999207,2cyclictest11050irq/107-eth%d12:17:491
11322999203,10cyclictest288993-21latency_hist12:05:211
11322899208,1cyclictest11050irq/107-eth%d11:27:470
11322899202,16cyclictest203749-21/usr/sbin/munin10:17:460
113228992018,1cyclictest0-21swapper/010:52:490
11322899201,6cyclictest171343-21ssh09:37:490
113228992016,3cyclictest0-21swapper/007:22:360
113228992016,2cyclictest0-21swapper/007:32:360
113228992016,2cyclictest0-21swapper/007:32:360
113228992010,3cyclictest0-21swapper/012:22:450
113228992010,3cyclictest0-21swapper/012:22:450
112699200,4rtkit-daemon1125-21rtkit-daemon11:47:211
11323099195,8cyclictest0-21swapper/208:27:472
11323099194,9cyclictest287179-21ssh12:02:432
113230991917,1cyclictest0-21swapper/210:05:442
11322999197,5cyclictest269000-21apt11:40:201
11322999195,11cyclictest182653-21ntpq09:52:431
113229991916,2cyclictest1008-21mta-sts-daemon12:32:441
113229991913,4cyclictest291055-21/usr/sbin/munin12:07:431
11322899195,10cyclictest0-21swapper/007:40:220
113228991919,0cyclictest0-21swapper/007:27:440
113228991915,2cyclictest184720-21latency_hist09:55:210
11322899191,4cyclictest167315-21grep09:33:010
113228991913,1cyclictest0-21swapper/009:42:430
11323099185,10cyclictest113190-21munin-run07:15:212
11323099183,12cyclictest131711-21/usr/sbin/munin08:07:482
11323099183,10cyclictest111788-21systemd-journal12:07:432
113230991814,3cyclictest237467-21idleruntime-cro11:00:212
113230991814,2cyclictest159773-21unixbench_singl09:22:502
11322999182,9cyclictest111788-21systemd-journal09:27:391
113229991815,2cyclictest1008-21mta-sts-daemon11:42:471
11322899189,8cyclictest1008-21mta-sts-daemon08:57:490
11322899186,9cyclictest150150-21idleruntime-cro09:05:210
11322899182,16cyclictest0-21swapper/008:42:350
112699180,0rtkit-daemon0-21swapper/110:59:171
11323099176,9cyclictest265538-21ssh11:35:242
11323099175,9cyclictest111788-21systemd-journal10:28:032
11323099175,8cyclictest154547-21/usr/sbin/munin09:17:402
11323099175,10cyclictest992-21lldpd12:31:362
11323099173,9cyclictest140900-21fschecks_time08:37:402
11323099173,12cyclictest245811-21apt-config11:10:212
11323099172,12cyclictest121310-21/usr/sbin/munin07:37:482
113230991713,2cyclictest296081-21grep12:12:502
113230991712,3cyclictest136948-21unixbench_singl08:22:562
11322999173,11cyclictest114111-21/usr/sbin/munin07:17:391
11322999172,9cyclictest245813-21apt-config11:10:211
11322999172,12cyclictest111788-21systemd-journal11:27:181
113229991714,2cyclictest0-21swapper/109:25:211
113229991713,3cyclictest278021-21fschecks_count11:52:381
113229991712,4cyclictest122826-21ntp_kernel_err07:42:391
113229991711,4cyclictest128637-21grep07:57:501
11322899172,11cyclictest139159-21fschecks_count08:32:470
113228991714,3cyclictest0-21swapper/007:57:380
113228991714,1cyclictest0-21swapper/008:27:410
11322899171,12cyclictest236128-21/usr/sbin/munin10:57:520
112699170,2rtkit-daemon1125-21rtkit-daemon08:49:140
11323199164,5cyclictest0-21swapper/312:02:433
11323099169,5cyclictest0-21swapper/210:32:402
11323099168,7cyclictest351ktimers/211:46:542
11323099167,6cyclictest259-21jbd2/mmcblk0p2-809:07:412
11323099165,7cyclictest223054-21ntpq10:42:432
11323099164,5cyclictest259166-21ssh11:27:412
11323099163,11cyclictest231131-21/usr/sbin/munin10:52:412
11323099162,9cyclictest185018-21apt-get09:55:242
11323099162,11cyclictest134282-21fschecks_time08:17:362
113230991612,3cyclictest125073-21unixbench_singl07:47:492
11323099160,14cyclictest305346-21grep12:22:512
11323099160,14cyclictest305346-21grep12:22:512
11322999166,7cyclictest0-21swapper/107:15:211
11322999165,8cyclictest145920-21grep08:52:461
11322999163,9cyclictest127294-21grep07:55:211
11322999163,8cyclictest155326-21ssh09:17:411
11322999163,11cyclictest226658-21fschecks_time10:47:401
11322999163,11cyclictest111788-21systemd-journal07:27:451
11322999161,7cyclictest137015-21sendmail-msp08:27:401
113229991610,5cyclictest0-21swapper/112:22:511
113229991610,5cyclictest0-21swapper/112:22:511
11322999160,8cyclictest111788-21systemd-journal09:07:451
113228991611,4cyclictest120856-21ntp_kernel_pll_07:37:420
11322899161,10cyclictest251507-21diskstats11:17:380
11323199153,7cyclictest0-21swapper/309:17:413
11323199152,7cyclictest0-21swapper/308:27:483
11323099156,8cyclictest271448-21/usr/sbin/munin11:42:502
11323099154,7cyclictest143597-21sendmail-msp08:48:072
11323099154,5cyclictest174864-21/usr/sbin/munin09:42:432
11323099153,9cyclictest176294-21sendmail-msp09:45:462
11323099150,10cyclictest118276-21cat07:30:212
11322999159,4cyclictest0-21swapper/107:32:411
11322999159,4cyclictest0-21swapper/107:32:411
11322999156,8cyclictest190977-21ntpq10:02:441
11322999154,7cyclictest256453-21/usr/sbin/munin11:22:531
11322999153,9cyclictest198878-21/usr/sbin/munin10:12:381
11322999153,7cyclictest139930-21/usr/sbin/munin08:32:561
11322999153,7cyclictest111788-21systemd-journal12:25:431
11322999152,9cyclictest324457-21/usr/sbin/munin12:42:481
11322999152,8cyclictest11050irq/107-eth%d11:15:241
113229991512,3cyclictest133118-21ntp_kernel_pll_08:12:421
113229991512,2cyclictest125304-21latency_hist07:50:211
11322999151,10cyclictest176312-21grep09:45:211
11322999150,11cyclictest222916-21/usr/sbin/munin10:42:411
11322899155,7cyclictest114221-21/usr/sbin/munin07:17:400
11322899153,9cyclictest0-21swapper/007:50:220
11322899150,10cyclictest270217-21/usr/sbin/munin11:42:490
11322899150,10cyclictest0-21swapper/011:57:480
112699150,2rtkit-daemon1125-21rtkit-daemon08:15:420
112699150,1rtkit-daemon0-21swapper/107:21:311
11323199145,5cyclictest0-21swapper/309:27:393
11323199144,6cyclictest0-21swapper/310:07:473
11323199144,5cyclictest0-21swapper/310:17:463
11323199143,9cyclictest0-21swapper/307:50:223
11323199143,6cyclictest0-21swapper/311:42:413
11323199142,7cyclictest0-21swapper/312:38:163
11323199141,6cyclictest0-21swapper/310:02:443
11323099144,6cyclictest114430-21/usr/sbin/munin07:17:432
11323099143,9cyclictest283163-21ssh11:57:492
11323099143,7cyclictest323621-21if_end012:42:392
11323099143,10cyclictest122317-21/usr/sbin/munin07:42:352
11323099142,9cyclictest318647-21/usr/sbin/munin12:37:402
11323099142,8cyclictest207041-21/usr/sbin/munin10:22:392
113230991412,1cyclictest0-21swapper/210:47:412
113230991411,2cyclictest167370-21unixbench_multi09:33:012
113230991411,2cyclictest153345-21grep09:12:522
113230991411,2cyclictest140197-21unixbench_multi08:32:582
113230991411,2cyclictest129448-21gltestperf08:02:402
11323099141,10cyclictest219101-21ntp_states10:37:432
11322999145,5cyclictest281736-21/usr/sbin/munin11:57:421
11322999144,7cyclictest170561-21/usr/sbin/munin09:37:401
11322999144,7cyclictest152971-21/usr/sbin/munin09:12:481
11322999143,3cyclictest0-21swapper/108:42:481
11322999142,9cyclictest121453-21sh07:40:201
113229991411,2cyclictest0-21swapper/109:05:211
11322999141,11cyclictest1005-21mta-sts-daemon09:55:241
11322999141,10cyclictest134255-21grep08:17:361
113229991410,3cyclictest1006-21mta-sts-daemon10:52:371
11322899148,1cyclictest223473-21unixbench_multi10:42:480
11322899143,8cyclictest146837-21/usr/sbin/munin08:52:560
113228991411,1cyclictest0-21swapper/007:47:400
11323199134,5cyclictest0-21swapper/310:32:393
11323199134,5cyclictest0-21swapper/309:07:453
11323199134,4cyclictest0-21swapper/309:32:503
11323199133,6cyclictest0-21swapper/311:02:413
11323199133,6cyclictest0-21swapper/310:57:443
11323199133,5cyclictest0-21swapper/310:52:423
11323199133,5cyclictest0-21swapper/309:22:443
11323199132,8cyclictest0-21swapper/307:40:223
11323199132,6cyclictest0-21swapper/312:17:433
11323199132,6cyclictest0-21swapper/308:22:503
11323199132,5cyclictest0-21swapper/310:42:413
11323199131,7cyclictest0-21swapper/309:47:203
11323199131,6cyclictest0-21swapper/312:32:383
11323199130,8cyclictest0-21swapper/310:12:353
11323099134,6cyclictest132284-21/usr/sbin/munin08:12:482
11323099133,7cyclictest128936-21latency_hist08:00:212
11323099132,7cyclictest149284-21if_wlan009:02:372
11323099131,10cyclictest255821-21missed_timers11:22:442
11323099131,10cyclictest116363-21sed07:22:482
11322999138,4cyclictest1007-21mta-sts-daemon10:37:481
11322999137,3cyclictest239538-21/usr/sbin/munin11:02:401
11322999133,8cyclictest0-21swapper/108:37:361
11322999133,6cyclictest0-21swapper/112:12:451
11322999132,6cyclictest129309-21cut08:02:391
11322999131,10cyclictest147092-21/usr/sbin/munin08:57:541
11322899136,3cyclictest152083-21aten2.4-expect09:12:360
11322899132,8cyclictest967-21snmpd08:22:440
112699130,4rtkit-daemon1005-21mta-sts-daemon09:31:291
11323199126,4cyclictest0-21swapper/309:38:153
11323199125,4cyclictest0-21swapper/312:27:443
11323199125,3cyclictest0-21swapper/309:55:243
11323199124,4cyclictest0-21swapper/311:05:233
11323199124,4cyclictest0-21swapper/309:52:433
11323199124,3cyclictest0-21swapper/308:57:473
11323199123,5cyclictest0-21swapper/312:22:393
11323199123,5cyclictest0-21swapper/312:22:393
11323199123,5cyclictest0-21swapper/311:52:373
11323199123,5cyclictest0-21swapper/311:35:233
11323199123,4cyclictest0-21swapper/311:17:483
11323199122,5cyclictest0-21swapper/311:57:363
11323199122,5cyclictest0-21swapper/311:46:393
11323199122,5cyclictest0-21swapper/311:32:473
11323199122,5cyclictest0-21swapper/309:12:443
11323199122,4cyclictest0-21swapper/307:57:443
11323199121,6cyclictest0-21swapper/312:42:393
11323199121,6cyclictest0-21swapper/312:07:393
11323199121,5cyclictest0-21swapper/308:37:433
11323099122,9cyclictest146372-21/usr/sbin/munin08:52:512
11323099121,8cyclictest125690-21apt-get07:50:222
11323099120,11cyclictest143426-21sed08:42:482
11322999124,5cyclictest207461-21ssh10:22:421
11322999123,6cyclictest143895-21/usr/sbin/munin08:47:401
11322899125,5cyclictest0-21swapper/008:12:400
11322899123,3cyclictest140990-21cut08:37:400
11322899122,8cyclictest128974-21/usr/sbin/munin08:02:420
11323199114,4cyclictest0-21swapper/307:17:373
11323199113,3cyclictest0-21swapper/311:22:493
11323199112,6cyclictest0-21swapper/308:17:373
11323199112,6cyclictest0-21swapper/307:27:483
11323199112,5cyclictest0-21swapper/311:27:413
11323199112,5cyclictest0-21swapper/310:27:413
11323199112,5cyclictest0-21swapper/308:02:393
11323199112,4cyclictest0-21swapper/308:06:123
11323199112,4cyclictest0-21swapper/307:47:233
11323199110,9cyclictest0-21swapper/309:42:433
11323199110,7cyclictest0-21swapper/311:10:213
11323199110,7cyclictest0-21swapper/308:48:013
11323199104,3cyclictest0-21swapper/310:47:013
11323199103,6cyclictest0-21swapper/308:32:493
11323199103,3cyclictest0-21swapper/312:12:383
11323199103,3cyclictest0-21swapper/307:22:373
11323199102,5cyclictest0-21swapper/310:37:373
11323199102,5cyclictest0-21swapper/308:12:383
11323199102,5cyclictest0-21swapper/307:37:433
11323199101,6cyclictest0-21swapper/307:35:213
11323199101,6cyclictest0-21swapper/307:35:213
11323199101,5cyclictest0-21swapper/308:42:353
11323199101,3cyclictest0-21swapper/309:02:373
11323199100,5cyclictest0-21swapper/310:22:363
1132319991,5cyclictest0-21swapper/308:52:433
1132319962,3cyclictest0-21swapper/307:15:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional