You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 20:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 23, 2026 12:44:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32222222790,15sleep232219-21apt-config06:56:302
32222222790,15sleep232219-21apt-config06:56:302
30895215612,96sleep030975-21fschecks_time06:51:520
30895215612,96sleep030975-21fschecks_time06:51:520
32317991173,39cyclictest7705-21apt-get11:36:480
32317991124,32cyclictest18973-21cstates07:51:430
32344991113,78cyclictest24149-21apt-get10:16:442
32344991083,81cyclictest352-21runrttasks07:56:532
32344991083,81cyclictest352-21runrttasks07:56:532
32184210819,53sleep132063-21/usr/sbin/munin06:56:301
32184210819,53sleep132063-21/usr/sbin/munin06:56:301
32317991053,53cyclictest31509-21kernelversion11:22:070
323269910124,28cyclictest0-21swapper/110:53:331
323269910124,28cyclictest0-21swapper/110:53:331
32317999861,15cyclictest181rcu_preempt10:01:420
3231799975,70cyclictest24933-21modprobe11:11:480
32317999715,32cyclictest8680-21apt-get09:52:160
32317999613,76cyclictest24186-21ssh10:16:430
32317999467,19cyclictest15446-21latency_hist07:41:280
3231799943,83cyclictest12467-21runrttasks07:32:100
3231799937,77cyclictest32604-21apt-get06:56:440
3231799937,77cyclictest32604-21apt-get06:56:440
32317999219,34cyclictest20929-21apt-get10:11:400
32326999128,23cyclictest24961-21ssh12:05:461
32326999123,54cyclictest24300-21ssh10:17:021
3234499903,64cyclictest24877-21apt-get11:11:422
32326999028,24cyclictest9301-21seq10:46:241
3231799903,42cyclictest352-21runrttasks11:19:120
32344998921,14cyclictest0-21swapper/211:52:042
32344998921,14cyclictest0-21swapper/211:52:042
32326998928,23cyclictest25886-21seq09:26:321
32326998928,23cyclictest25886-21seq09:26:321
32326998828,23cyclictest1234-21seq09:38:561
32326998827,27cyclictest1143-21seq11:26:171
32326998725,23cyclictest11701-21seq07:29:291
3235599862,34cyclictest308-21chrt06:57:203
3235599862,34cyclictest308-21chrt06:57:203
32326998661,17cyclictest32295-21cyclictest08:56:561
32317998664,17cyclictest9923-21fschecks_count10:46:470
3231799862,76cyclictest16758-21kworker/u17:3+ext4-rsv-conversion07:57:140
3231799862,76cyclictest16758-21kworker/u17:3+ext4-rsv-conversion07:57:140
32326998536,38cyclictest0-21swapper/110:26:421
32326998536,38cyclictest0-21swapper/110:26:421
32326998535,37cyclictest0-21swapper/107:36:371
32326998529,24cyclictest352-21runrttasks10:58:281
32326998527,24cyclictest16628-21seq07:42:081
32326998523,25cyclictest352-21runrttasks11:49:121
32326998522,28cyclictest7380-21munin-plugin-st08:56:251
32326998522,28cyclictest7380-21munin-plugin-st08:56:251
32326998517,50cyclictest8680-21apt-get09:51:401
32317998555,10cyclictest181rcu_preempt11:31:370
32317998555,10cyclictest181rcu_preempt11:31:370
3235599843,36cyclictest22867-21taskset08:01:563
3234499842,58cyclictest12366-21apt-get07:31:412
32326998427,23cyclictest10111-21seq07:25:031
32326998427,23cyclictest10111-21seq07:25:031
32326998423,30cyclictest8153-21apt-get09:51:251
32317998458,17cyclictest7387-21diskmemload10:42:010
3231799845,71cyclictest22355-21apt-get09:21:450
32344998361,15cyclictest22339-21cpu08:01:422
32326998323,25cyclictest13641-21seq07:35:041
32317998356,10cyclictest181rcu_preempt08:01:410
32317998348,11cyclictest181rcu_preempt07:21:390
32317998348,11cyclictest181rcu_preempt07:21:390
32344998262,14cyclictest2731-21cut09:41:462
32344998262,14cyclictest2731-21cut09:41:462
32326998220,27cyclictest352-21runrttasks08:17:321
32317998260,15cyclictest16239-21ssh10:56:530
32344998160,13cyclictest0-21swapper/211:42:022
32344998160,13cyclictest0-21swapper/211:42:022
32326998145,28cyclictest22059-21modprobe08:01:251
32326998145,28cyclictest22059-21modprobe08:01:251
32326998124,21cyclictest0-21swapper/108:23:201
32326998119,26cyclictest0-21swapper/108:06:271
32317998155,19cyclictest24325-21latency_hist11:11:280
32317998155,19cyclictest24325-21latency_hist11:11:280
32317998151,9cyclictest181rcu_preempt07:46:400
32317998059,14cyclictest32295-21cyclictest12:22:540
3231799803,37cyclictest17741-21grep09:12:030
3231799803,37cyclictest17741-21grep09:12:030
3235599794,34cyclictest20707-21chrt09:17:033
3235599793,45cyclictest21158-21taskset10:12:153
32344997956,16cyclictest26204-21fschecks_time09:26:472
32344997956,16cyclictest26204-21fschecks_time09:26:472
3234499793,38cyclictest28990-21fschecks_count08:21:482
32326997912,23cyclictest0-21swapper/108:39:321
32326997912,23cyclictest0-21swapper/108:39:321
3231799798,35cyclictest15-21ksoftirqd/008:51:400
3231799798,35cyclictest15-21ksoftirqd/008:51:400
32317997959,14cyclictest32295-21cyclictest09:20:500
32317997955,15cyclictest23109-21ssh12:01:530
32317997943,28cyclictest15369-21ssh09:08:350
32344997847,22cyclictest21889-21fschecks_count11:06:472
32344997847,22cyclictest21889-21fschecks_count11:06:472
32326997832,33cyclictest0-21swapper/111:06:381
32326997832,33cyclictest0-21swapper/111:06:381
32326997823,26cyclictest13526-21latency_hist11:46:281
32326997823,26cyclictest13526-21latency_hist11:46:281
32326997814,34cyclictest0-21swapper/112:06:391
32317997854,16cyclictest544-21cron12:01:250
3231799784,41cyclictest352-21runrttasks10:55:050
3231799784,41cyclictest352-21runrttasks10:55:050
3231799783,43cyclictest2683-21fschecks_count09:41:460
3231799783,43cyclictest2683-21fschecks_count09:41:460
32317997823,29cyclictest181rcu_preempt10:36:420
3235599773,52cyclictest0-21swapper/309:52:163
32344997756,14cyclictest5071-21ssh11:31:542
32344997756,14cyclictest5071-21ssh11:31:542
32344997751,19cyclictest4540-21kworker/u17:2+events_unbound11:41:242
32326997761,10cyclictest22664-21latency_hist09:21:291
32326997754,17cyclictest2399-21journal-offline07:01:401
32326997754,17cyclictest2399-21journal-offline07:01:401
32326997732,34cyclictest0-21swapper/107:51:391
3231799773,39cyclictest7833-21cstates08:56:430
32344997657,13cyclictest298-21in:imuxsock08:41:252
32344997657,13cyclictest298-21in:imuxsock08:41:252
32344997651,18cyclictest32178-21fschecks_time09:36:472
32344997647,21cyclictest15772-21cstates10:56:422
3234499762,51cyclictest13608-21latency_hist09:06:292
3234499762,51cyclictest13608-21latency_hist09:06:292
32326997633,31cyclictest0-21swapper/108:46:411
32326997623,29cyclictest277-21dbus-daemon10:26:271
32317997652,15cyclictest352-21runrttasks11:42:390
32317997652,15cyclictest352-21runrttasks11:42:390
32326997530,40cyclictest0-21swapper/107:46:401
32326997528,37cyclictest22886-21/usr/sbin/munin09:23:251
32326997526,33cyclictest2607-21ssh10:34:211
32326997526,20cyclictest19676-21snmpd10:48:261
32326997514,43cyclictest18891-21cut11:01:471
32326997514,43cyclictest18891-21cut11:01:471
32317997557,12cyclictest17460-21sshd07:16:410
32317997557,12cyclictest17460-21sshd07:16:410
3231799755,47cyclictest20528-21sort10:11:280
3231799755,30cyclictest352-21runrttasks10:27:340
3231799755,30cyclictest352-21runrttasks10:27:340
32317997552,18cyclictest15606-21kworker/u19:0+events_unbound12:11:250
32317997542,12cyclictest0-21swapper/012:21:240
3231799752,28cyclictest16614-21/usr/sbin/munin11:51:500
3231799752,28cyclictest16614-21/usr/sbin/munin11:51:500
32344997458,9cyclictest22669-21sh09:21:292
32344997454,14cyclictest32295-21cyclictest10:06:432
32344997446,19cyclictest27542-21kernelversion08:16:512
32326997432,37cyclictest0-21swapper/111:16:391
32326997429,34cyclictest0-21swapper/111:56:391
32326997418,21cyclictest18985-21sh09:15:221
32326997418,21cyclictest18985-21sh09:15:221
32317997451,15cyclictest2374-21systemd-journal07:26:510
32317997432,13cyclictest181rcu_preempt09:28:090
32317997432,13cyclictest181rcu_preempt09:28:090
3234499739,54cyclictest8153-21apt-get09:51:402
32344997356,11cyclictest277-21dbus-daemon08:36:262
32344997356,11cyclictest277-21dbus-daemon08:36:262
32344997353,14cyclictest32295-21cyclictest07:08:502
32344997353,14cyclictest32295-21cyclictest07:08:502
32344997350,13cyclictest0-21swapper/209:47:012
32344997344,13cyclictest181rcu_preempt11:57:042
3232699738,48cyclictest21261-21cat10:12:181
32326997327,35cyclictest0-21swapper/108:11:411
32326997320,21cyclictest0-21swapper/108:46:041
3231799734,37cyclictest16969-21cron07:46:250
32344997252,12cyclictest0-21swapper/210:47:022
32326997251,15cyclictest1636-21latency_hist07:01:281
32326997251,15cyclictest1636-21latency_hist07:01:281
32326997236,23cyclictest5680-21apt-get07:11:371
32326997229,19cyclictest27064-21seq11:15:141
32326997228,32cyclictest0-21swapper/108:31:401
32326997228,32cyclictest0-21swapper/108:31:401
32326997220,19cyclictest1338-21sh12:20:321
32317997252,14cyclictest544-21cron08:26:260
3231799724,33cyclictest31667-21latency_hist09:36:270
3231799723,56cyclictest3010-21tune2fs08:41:490
32317997234,27cyclictest29041-21netstat12:11:520
32344997147,11cyclictest0-21swapper/210:26:422
32344997147,11cyclictest0-21swapper/210:26:422
32326997149,13cyclictest0-21swapper/111:36:471
32326997130,36cyclictest0-21swapper/108:06:361
32317997149,16cyclictest2158-21sh09:41:260
32317997146,18cyclictest1-21systemd07:12:510
32317997134,27cyclictest1-21systemd11:51:270
32344997051,13cyclictest22767-21fschecks_count12:01:462
32344997048,16cyclictest2374-21systemd-journal07:46:452
32344997045,16cyclictest0-21swapper/207:51:482
32344997019,31cyclictest5949-21fschecks_time07:11:482
32326997057,9cyclictest32295-21cyclictest11:35:231
32326997057,9cyclictest32295-21cyclictest11:35:231
32326997051,13cyclictest2374-21systemd-journal12:16:251
32326997031,35cyclictest0-21swapper/110:06:371
32326997031,32cyclictest0-21swapper/110:01:411
32326997027,22cyclictest3589-21seq09:42:081
32326997027,22cyclictest3589-21seq09:42:081
32326997020,22cyclictest0-21swapper/108:28:101
32317997052,12cyclictest18944-21fschecks_time11:01:470
32317997052,12cyclictest18944-21fschecks_time11:01:470
3231799704,51cyclictest14376-21munin-plugin-st10:01:250
3231799704,51cyclictest14376-21munin-plugin-st10:01:250
32317997030,32cyclictest0-21swapper/011:27:110
3234499697,51cyclictest21263-21/usr/sbin/munin10:12:182
32344996948,15cyclictest29156-21proc_pri12:11:562
3234499693,55cyclictest31010-21apt-get11:21:532
3234499693,31cyclictest7387-21diskmemload09:33:242
3234499693,30cyclictest6633-21/usr/sbin/munin10:41:522
3234499693,27cyclictest22355-21apt-get09:21:372
32326996943,16cyclictest29646-21ssh09:32:011
32326996930,29cyclictest0-21swapper/107:16:371
32326996930,29cyclictest0-21swapper/107:16:371
32326996928,31cyclictest2241-21fschecks_time12:21:451
32326996928,18cyclictest3512-21seq11:29:291
32326996918,29cyclictest0-21swapper/107:10:381
32326996918,29cyclictest0-21swapper/107:10:381
3231799694,43cyclictest10940-21cut09:01:480
3231799694,43cyclictest10940-21cut09:01:480
32317996940,13cyclictest181rcu_preempt09:46:400
3231799693,53cyclictest352-21runrttasks08:46:490
32317996920,37cyclictest29879-21latency_hist10:26:270
3133526917,34sleep30-21swapper/306:52:083
3133526917,34sleep30-21swapper/306:52:083
32344996841,17cyclictest0-21swapper/208:26:502
3234499683,28cyclictest6448-21latency_hist10:41:282
32326996854,9cyclictest14347-21runrttasks10:01:241
32326996854,9cyclictest14347-21runrttasks10:01:241
32326996830,28cyclictest13598-21latency_hist09:06:291
32326996830,28cyclictest13598-21latency_hist09:06:291
32326996829,35cyclictest0-21swapper/110:36:381
3231799684,57cyclictest161ktimers/007:02:230
3231799684,57cyclictest161ktimers/007:02:230
3231799684,48cyclictest32612-21grep08:31:560
3231799684,48cyclictest32612-21grep08:31:560
32317996844,16cyclictest1307-21ssh10:31:560
3231799683,43cyclictest26917-21latency_hist08:16:290
310892680,4sleep3451rcuc/311:21:503
32355996710,36cyclictest0-21swapper/311:36:483
3234499674,41cyclictest352-21runrttasks06:59:102
3234499674,41cyclictest352-21runrttasks06:59:102
32344996742,16cyclictest2493-21timerwakeupswit11:27:042
32344996739,19cyclictest27914-21sh11:16:422
3234499673,37cyclictest16258-21ssh10:03:222
3234499673,30cyclictest7387-21diskmemload10:23:582
3234499672,44cyclictest16685-21/usr/sbin/munin09:11:452
3234499672,44cyclictest16685-21/usr/sbin/munin09:11:452
3231799673,44cyclictest4903-21timerwakeupswit07:07:010
3231799673,44cyclictest4903-21timerwakeupswit07:07:010
32344996648,13cyclictest14720-21swap07:37:022
3234499664,40cyclictest4631-21fschecks_count08:46:472
3234499663,35cyclictest17460-21sshd07:41:442
3234499663,32cyclictest11989-21grep09:56:472
3234499663,32cyclictest11989-21grep09:56:472
3234499662,43cyclictest6937-21unixbench_multi08:52:012
3234499662,43cyclictest6937-21unixbench_multi08:52:012
3234499662,27cyclictest9688-21timerandwakeup07:22:012
3234499662,27cyclictest9688-21timerandwakeup07:22:012
32326996634,23cyclictest16664-21ssh11:51:431
32326996634,23cyclictest16664-21ssh11:51:431
32326996629,32cyclictest0-21swapper/109:06:411
3234499657,28cyclictest1493-21apt-get07:01:412
3234499657,28cyclictest1493-21apt-get07:01:412
32344996549,10cyclictest554-21kworker/u17:0-ext4-rsv-conversion12:26:262
32344996546,11cyclictest0-21swapper/207:26:512
3234499654,42cyclictest15341-21latency_hist10:56:292
3234499654,42cyclictest15341-21latency_hist10:56:292
32344996544,15cyclictest32494-21unixbench_multi12:17:012
32344996541,18cyclictest3364-21cut10:36:272
3234499653,40cyclictest25753-21/usr/sbin/munin12:06:462
3231799654,46cyclictest28175-21awk08:17:040
32317996537,9cyclictest181rcu_preempt08:36:410
32317996537,9cyclictest181rcu_preempt08:36:410
32317996518,34cyclictest24345-21cut08:06:500
3234499644,32cyclictest24484-21ntp_kernel_pll_08:06:532
32344996443,15cyclictest2374-21systemd-journal08:57:502
32344996442,14cyclictest0-21swapper/211:01:412
32344996442,14cyclictest0-21swapper/211:01:412
3231799643,31cyclictest352-21runrttasks08:30:560
3235599638,41cyclictest0-21swapper/309:21:463
32344996332,22cyclictest8611-21cron07:21:252
32344996332,22cyclictest8611-21cron07:21:252
3235599629,31cyclictest0-21swapper/311:11:473
3234499624,38cyclictest13701-21/usr/sbin/munin09:06:532
32344996234,21cyclictest32295-21cyclictest08:12:002
3234499623,26cyclictest3402-21processes08:42:002
122202620,7sleep30-21swapper/310:51:053
3234499593,36cyclictest352-21runrttasks11:48:172
3235599582,43cyclictest31008-21taskset12:16:033
3235599572,40cyclictest11333-21taskset07:27:013
3235599563,36cyclictest4249-21taskset11:31:273
3235599563,34cyclictest3819-21taskset10:36:433
3235599562,37cyclictest5860-21chrt11:32:453
3235599562,37cyclictest5860-21chrt11:32:453
3235599562,36cyclictest32532-21chrt10:30:393
3235599562,36cyclictest32532-21chrt10:30:393
3235599553,38cyclictest13698-21chrt10:52:033
3235599553,38cyclictest13698-21chrt10:52:033
3235599553,37cyclictest3824-21chrt09:42:483
3235599553,37cyclictest3824-21chrt09:42:483
3235599553,37cyclictest3515-21chrt08:42:023
3235599552,35cyclictest3135-21taskset12:22:123
32355995516,31cyclictest0-21swapper/310:16:443
3235599544,35cyclictest4614-21chrt07:06:563
3235599544,35cyclictest4614-21chrt07:06:563
3235599543,36cyclictest28838-21chrt09:31:293
3235599543,36cyclictest14327-21taskset10:01:213
3235599543,36cyclictest14327-21taskset10:01:213
3235599543,33cyclictest9846-21chrt07:22:023
3235599543,33cyclictest9846-21chrt07:22:023
3235599542,37cyclictest14009-21chrt07:36:363
3235599542,34cyclictest7571-21chrt07:16:483
3235599542,34cyclictest7571-21chrt07:16:483
32355995411,30cyclictest0-21swapper/307:56:423
32355995411,30cyclictest0-21swapper/307:56:423
3235599534,37cyclictest1081-21taskset09:38:313
3235599533,38cyclictest23898-21taskset12:02:453
3235599533,37cyclictest17093-21taskset10:05:423
3235599533,35cyclictest5788-21chrt08:51:253
3235599533,34cyclictest17462-21chrt09:12:003
3235599533,34cyclictest17462-21chrt09:12:003
3235599533,33cyclictest20847-21chrt11:57:303
3235599533,33cyclictest17272-21chrt11:51:593
3235599533,33cyclictest17272-21chrt11:51:593
3235599533,33cyclictest11069-21chrt11:41:493
3235599533,33cyclictest11069-21chrt11:41:493
3235599533,31cyclictest27842-21chrt08:16:593
3235599532,36cyclictest11719-21chrt09:02:033
3235599532,36cyclictest11719-21chrt09:02:033
3235599523,38cyclictest17961-21chrt11:00:263
3235599523,35cyclictest16257-21taskset11:51:183
3235599522,37cyclictest30812-21chrt11:21:303
3235599522,37cyclictest18622-21taskset11:01:353
3235599522,37cyclictest18622-21taskset11:01:353
3235599514,33cyclictest2065-21chrt07:01:333
3235599514,33cyclictest2065-21chrt07:01:333
3235599513,33cyclictest29844-21chrt10:26:253
3235599512,33cyclictest7683-21chrt08:56:363
3235599512,33cyclictest31132-21chrt08:26:593
3235599512,32cyclictest18997-21chrt07:51:433
32355995116,15cyclictest0-21swapper/307:31:393
3235599503,34cyclictest2541-21chrt08:41:253
3235599503,34cyclictest2541-21chrt08:41:253
3235599502,35cyclictest967-21chrt08:36:273
3235599502,35cyclictest967-21chrt08:36:273
3235599502,29cyclictest24082-21taskset08:06:423
3235599494,32cyclictest6695-21taskset09:47:223
3235599493,35cyclictest20829-21chrt10:11:303
3235599493,35cyclictest1275-21chrt12:20:213
3235599493,34cyclictest14655-21chrt09:07:023
3235599483,36cyclictest7948-21chrt10:42:343
3235599483,31cyclictest27665-21taskset09:28:503
3235599473,34cyclictest2865-21chrt10:35:053
3235599472,33cyclictest7451-21chrt08:56:283
3235599472,33cyclictest7451-21chrt08:56:283
3235599463,32cyclictest30378-21chrt09:33:043
3235599462,33cyclictest25710-21chrt12:06:433
2461524611,15sleep30-21swapper/311:11:293
2461524611,15sleep30-21swapper/311:11:293
3235599442,31cyclictest15978-21chrt07:41:513
3235599433,28cyclictest17266-21taskset07:46:373
3235599413,27cyclictest29043-21chrt08:21:493
3235599403,25cyclictest5841-21taskset07:11:463
3235599373,25cyclictest25724-21taskset08:11:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional