You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 23:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon May 25, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9927210911,69sleep19969-21/usr/sbin/munin06:56:091
10755991063,92cyclictest12279-21apt-get07:05:421
107609910347,11cyclictest181rcu_preempt10:11:182
107609910071,23cyclictest1-21systemd09:25:282
107609910071,23cyclictest1-21systemd09:25:282
1075599997,79cyclictest15412-21apt-get08:50:451
10755999820,60cyclictest5114-21kworker/u17:3+flush-179:009:26:041
10752999868,12cyclictest181rcu_preempt10:02:180
1075599973,51cyclictest16703-21apt-get07:15:411
10755999728,35cyclictest26403-21/usr/sbin/munin11:55:501
1066829711,60sleep210692-21wc07:00:302
98162958,60sleep09259-21/usr/sbin/munin06:56:040
10755999553,37cyclictest0-21swapper/111:21:361
10755999553,37cyclictest0-21swapper/111:21:361
10752999478,9cyclictest0-21swapper/010:32:440
10752999478,9cyclictest0-21swapper/010:32:440
10760999356,9cyclictest7669-21ssh10:30:102
10752999269,17cyclictest8719-21latency_hist12:20:290
10752999144,12cyclictest181rcu_preempt10:40:520
1076599902,59cyclictest13681-21chrt09:45:453
10760999066,16cyclictest24637-21ssh10:03:402
10755998962,18cyclictest2255-21cron11:15:261
10755998960,19cyclictest23350-21fschecks_count10:55:491
1075599892,52cyclictest18381-21diskmemload09:42:261
10752998967,16cyclictest1-21systemd10:51:340
10760998846,33cyclictest19894-21kworker/u19:1+nfsiod09:26:462
10755998865,15cyclictest28065-21cpuspeed07:50:421
10755998842,37cyclictest0-21swapper/108:25:281
10755998842,37cyclictest0-21swapper/108:25:281
10755998834,49cyclictest0-21swapper/111:25:531
10752998869,12cyclictest16241-21sh09:50:190
1075599873,58cyclictest19441-21sshd10:49:341
10752998767,13cyclictest297-21systemd-logind08:30:280
10752998762,19cyclictest17732-21fschecks_count11:40:480
10760998659,21cyclictest18381-21diskmemload12:20:502
10760998659,21cyclictest18381-21diskmemload12:20:502
10760998649,14cyclictest3138-21ssh12:10:412
10755998641,37cyclictest0-21swapper/109:50:441
10755998641,37cyclictest0-21swapper/109:50:441
10760998532,10cyclictest181rcu_preempt11:26:102
10755998547,31cyclictest883-21apt-get09:25:321
10755998540,38cyclictest0-21swapper/107:15:301
10752998566,12cyclictest0-21swapper/010:16:010
10752998559,18cyclictest29582-21timerwakeupswit10:11:030
10760998462,14cyclictest30866-21ssh11:08:032
10760998462,14cyclictest30866-21ssh11:08:032
10760998450,19cyclictest1440-21kworker/u19:1+rpciod11:51:032
10755998447,29cyclictest0-21swapper/108:20:271
10755998447,29cyclictest0-21swapper/108:20:271
1075599842,58cyclictest13638-21apt-get09:46:071
10755998422,51cyclictest2114-21ls08:10:301
10755998418,30cyclictest0-21swapper/109:24:051
10752998462,12cyclictest0-21swapper/007:45:290
10755998337,38cyclictest0-21swapper/112:11:041
10752998353,10cyclictest181rcu_preempt09:05:300
10760998261,15cyclictest27384-21kworker/u17:0-ext4-rsv-conversion08:55:272
10760998258,16cyclictest8065-21vmstat08:26:062
10760998245,14cyclictest181rcu_preempt11:21:392
10760998245,14cyclictest181rcu_preempt11:21:392
10760998241,9cyclictest181rcu_preempt09:34:382
10752998260,9cyclictest181rcu_preempt11:59:030
10752998250,14cyclictest181rcu_preempt11:05:140
10752998247,17cyclictest13938-21ssh11:34:420
10752998247,17cyclictest13938-21ssh11:34:420
10752998243,29cyclictest28263-21grep07:50:480
10760998142,12cyclictest181rcu_preempt08:20:552
10760998142,12cyclictest181rcu_preempt08:20:552
10760998133,8cyclictest181rcu_preempt09:35:462
10760998133,8cyclictest181rcu_preempt09:35:462
10755998138,36cyclictest352-21runrttasks10:45:291
1075599813,68cyclictest11918-21/usr/sbin/munin08:41:001
10755998135,39cyclictest0-21swapper/109:31:021
10755998119,28cyclictest0-21swapper/112:06:141
10755998119,28cyclictest0-21swapper/112:06:141
10752998158,15cyclictest2374-21systemd-journal07:04:350
10752998151,11cyclictest181rcu_preempt11:29:390
10752998151,11cyclictest181rcu_preempt10:29:460
10752998134,16cyclictest0-21swapper/008:34:460
10760998043,9cyclictest181rcu_preempt08:16:032
10760998043,9cyclictest181rcu_preempt08:16:032
10760998035,7cyclictest181rcu_preempt12:06:042
10760998035,7cyclictest181rcu_preempt12:06:042
10760998033,11cyclictest181rcu_preempt09:20:272
10760998032,8cyclictest181rcu_preempt07:51:002
10760998026,12cyclictest181rcu_preempt10:55:292
10755998040,36cyclictest10741-21cyclictest10:21:171
10755998036,36cyclictest0-21swapper/110:30:591
10755998036,36cyclictest0-21swapper/110:30:591
10752998060,11cyclictest0-21swapper/012:05:490
10752998060,11cyclictest0-21swapper/012:05:490
10752998060,11cyclictest0-21swapper/011:05:360
10752998060,11cyclictest0-21swapper/011:05:360
10752998053,9cyclictest181rcu_preempt12:11:280
10752998052,7cyclictest181rcu_preempt07:11:030
10752998050,8cyclictest181rcu_preempt08:05:500
10752998027,18cyclictest0-21swapper/008:41:000
10760997953,20cyclictest2347-21fschecks_count10:20:482
10760997945,11cyclictest181rcu_preempt10:56:042
10760997943,15cyclictest181rcu_preempt09:41:072
1076099793,45cyclictest11877-21sort11:30:502
1076099793,45cyclictest11877-21sort11:30:502
10760997932,17cyclictest181rcu_preempt07:10:272
1075599796,56cyclictest29859-21chrt07:55:401
10755997959,13cyclictest8405-21cron08:30:261
1075599794,65cyclictest29945-21/usr/sbin/munin11:06:021
1075599794,65cyclictest29945-21/usr/sbin/munin11:06:021
10755997936,30cyclictest0-21swapper/111:50:481
1075599793,61cyclictest0-21swapper/110:35:371
1075299797,48cyclictest13266-21chrt09:45:290
10752997964,9cyclictest29990-21ssh09:19:270
10752997960,12cyclictest10741-21cyclictest11:51:390
10752997954,8cyclictest181rcu_preempt10:24:580
10752997953,8cyclictest181rcu_preempt11:19:070
10752997950,12cyclictest181rcu_preempt11:45:490
10752997941,25cyclictest1729-21kworker/u17:4+rpciod09:28:250
10752997936,8cyclictest181rcu_preempt10:45:540
10760997856,15cyclictest58-21kcompactd008:34:222
10760997853,17cyclictest352-21runrttasks10:46:042
10760997836,8cyclictest181rcu_preempt07:31:002
10760997832,13cyclictest181rcu_preempt12:28:082
1076099782,43cyclictest39-21ksoftirqd/208:45:562
10755997861,10cyclictest21201-21/usr/sbin/munin10:51:041
1075599783,43cyclictest0-21swapper/109:03:031
10755997827,41cyclictest0-21swapper/109:14:421
1075599782,67cyclictest15148-21latency_hist08:50:301
10752997860,11cyclictest10741-21cyclictest12:04:510
10752997856,9cyclictest181rcu_preempt07:21:030
10752997852,17cyclictest18381-21diskmemload09:58:470
10752997850,8cyclictest181rcu_preempt09:05:440
10752997850,12cyclictest181rcu_preempt09:11:210
10752997848,12cyclictest181rcu_preempt09:32:280
1076099779,58cyclictest13087-21apt-get09:45:412
10760997744,9cyclictest181rcu_preempt11:40:382
10760997742,9cyclictest15839-21ssh11:36:392
10760997733,14cyclictest31817-21fschecks_count10:15:482
10760997733,14cyclictest0-21swapper/209:10:502
10760997731,14cyclictest181rcu_preempt08:10:272
10755997736,33cyclictest0-21swapper/111:40:591
1075299777,55cyclictest5831-21ssh11:20:420
1075299777,55cyclictest5831-21ssh11:20:420
10752997756,13cyclictest23956-21timerandwakeup07:36:020
10752997748,11cyclictest181rcu_preempt10:38:360
10760997644,8cyclictest181rcu_preempt11:15:412
10760997633,7cyclictest181rcu_preempt08:56:032
10760997632,8cyclictest181rcu_preempt08:35:482
10760997632,13cyclictest181rcu_preempt11:59:252
10760997629,8cyclictest181rcu_preempt11:10:562
1075599763,65cyclictest11676-21modprobe12:25:261
1075599763,65cyclictest11676-21modprobe12:25:261
10755997625,40cyclictest12542-21sed11:31:041
10755997625,40cyclictest12542-21sed11:31:041
1075599762,42cyclictest181rcu_preempt12:15:391
10752997655,11cyclictest0-21swapper/008:40:290
10752997650,8cyclictest181rcu_preempt10:55:590
10752997649,10cyclictest181rcu_preempt09:50:550
10752997649,10cyclictest181rcu_preempt09:50:550
10752997648,20cyclictest21252-21sh07:30:260
10752997648,20cyclictest21252-21sh07:30:260
10752997646,8cyclictest181rcu_preempt07:06:100
10760997542,8cyclictest181rcu_preempt10:36:272
10760997533,8cyclictest181rcu_preempt12:16:372
10760997532,18cyclictest181rcu_preempt11:45:362
10760997528,12cyclictest181rcu_preempt07:20:552
10760997522,13cyclictest181rcu_preempt08:15:292
10760997522,13cyclictest181rcu_preempt08:15:292
1075599754,64cyclictest10189-21latency_hist09:40:291
1075599754,64cyclictest10189-21latency_hist09:40:291
1075599753,66cyclictest0-21swapper/110:10:431
10755997535,33cyclictest0-21swapper/109:20:081
10755997530,37cyclictest0-21swapper/110:10:301
1075599752,63cyclictest352-21runrttasks11:03:071
10755997526,39cyclictest0-21swapper/111:50:301
1075599752,55cyclictest10936-21apt-get07:00:381
10755997511,38cyclictest18629-21cat09:00:311
10752997547,9cyclictest181rcu_preempt08:56:000
10760997434,7cyclictest181rcu_preempt08:40:592
10760997433,10cyclictest181rcu_preempt10:40:592
10760997430,10cyclictest181rcu_preempt10:31:022
10760997430,10cyclictest181rcu_preempt10:31:022
10760997410,26cyclictest23766-21ps07:35:592
10755997445,17cyclictest22377-21processes09:06:011
1075599743,61cyclictest21264-21grep07:30:261
1075599743,61cyclictest21264-21grep07:30:261
1075599743,60cyclictest0-21swapper/107:35:391
10755997434,35cyclictest0-21swapper/110:00:261
10755997432,35cyclictest0-21swapper/110:30:261
10755997431,36cyclictest0-21swapper/111:15:511
1075599742,62cyclictest19821-21latency_hist07:25:301
10752997453,9cyclictest181rcu_preempt10:05:430
10752997451,7cyclictest181rcu_preempt11:36:200
10752997441,9cyclictest181rcu_preempt08:51:420
10752997440,11cyclictest58-21kcompactd012:28:470
10752997435,11cyclictest181rcu_preempt08:24:580
10752997435,11cyclictest181rcu_preempt08:24:580
10760997354,11cyclictest0-21swapper/210:07:342
10760997337,8cyclictest2374-21systemd-journal09:07:272
10760997326,13cyclictest181rcu_preempt09:03:382
10755997324,27cyclictest0-21swapper/110:18:341
1075299737,47cyclictest16703-21apt-get07:16:140
10752997353,11cyclictest0-21swapper/007:35:300
10752997329,11cyclictest181rcu_preempt09:36:100
10752997329,11cyclictest181rcu_preempt09:36:100
322732722,6sleep00-21swapper/009:22:280
322732722,6sleep00-21swapper/009:22:280
10760997255,7cyclictest0-21swapper/209:50:372
10760997255,7cyclictest0-21swapper/209:50:372
10760997244,10cyclictest181rcu_preempt09:57:062
1075599723,62cyclictest352-21runrttasks11:38:351
1075599723,62cyclictest12114-21ls12:25:441
1075599723,61cyclictest11668-21latency_hist08:40:291
10755997221,44cyclictest1-21systemd10:05:271
10755997220,44cyclictest0-21swapper/107:46:001
10752997248,12cyclictest0-21swapper/008:50:310
10752997224,10cyclictest181rcu_preempt08:04:350
10760997133,9cyclictest181rcu_preempt12:00:592
10760997116,31cyclictest30169-21sort07:56:292
10752997149,12cyclictest0-21swapper/012:20:530
10752997149,12cyclictest0-21swapper/012:20:530
10752997146,16cyclictest0-21swapper/008:20:290
10752997146,16cyclictest0-21swapper/008:20:290
10760997049,15cyclictest58-21kcompactd007:16:132
10760997022,10cyclictest181rcu_preempt07:46:002
1075599703,60cyclictest30057-21grep12:00:581
1075599702,58cyclictest9076-21sed08:30:511
10752997027,14cyclictest0-21swapper/008:10:470
10752997027,14cyclictest0-21swapper/008:10:470
1075599693,58cyclictest336-21latency_hist08:05:291
1075599692,54cyclictest21528-21sshd07:30:351
10752996953,10cyclictest352-21runrttasks07:50:310
10760996833,7cyclictest181rcu_preempt11:00:502
10760996817,11cyclictest181rcu_preempt08:01:022
10752996837,11cyclictest181rcu_preempt07:56:140
10752996822,9cyclictest181rcu_preempt11:15:180
10760996730,12cyclictest181rcu_preempt07:40:462
10755996726,33cyclictest0-21swapper/108:15:281
10755996726,33cyclictest0-21swapper/108:15:281
1075599672,51cyclictest25303-21ntp_states07:40:591
10760996633,10cyclictest181rcu_preempt07:25:452
10760996633,10cyclictest181rcu_preempt07:25:452
10760996632,8cyclictest181rcu_preempt07:14:442
1059326613,34sleep30-21swapper/307:00:273
10765996451,8cyclictest0-21swapper/309:26:503
10760996417,17cyclictest39-21ksoftirqd/207:05:342
1076599623,31cyclictest16707-21taskset07:15:413
1076599618,45cyclictest15422-21chrt08:50:423
1076599583,40cyclictest547-21chrt08:05:303
1076599566,28cyclictest0-21swapper/312:10:473
10765995613,28cyclictest0-21swapper/311:20:443
10765995613,28cyclictest0-21swapper/311:20:443
1076599554,37cyclictest24355-21taskset09:10:273
10765995541,9cyclictest451rcuc/309:41:243
1076599544,34cyclictest5316-21chrt09:31:023
10765995442,8cyclictest451rcuc/312:18:323
1076599533,39cyclictest9620-21chrt08:31:023
1076599533,38cyclictest3233-21chrt11:15:573
1076599533,36cyclictest16706-21chrt09:50:433
1076599533,36cyclictest16706-21chrt09:50:433
1076599533,35cyclictest10671-21chrt10:35:083
1076599533,35cyclictest10671-21chrt10:35:083
1076599532,41cyclictest7819-21taskset09:35:523
1076599532,41cyclictest7819-21taskset09:35:523
1076599532,39cyclictest26159-21chrt11:55:283
1076599524,33cyclictest26741-21chrt11:55:493
1076599523,37cyclictest11962-21taskset11:30:513
1076599523,37cyclictest11962-21taskset11:30:513
1076599523,36cyclictest7801-21chrt10:30:263
1076599523,35cyclictest31254-21taskset12:03:153
1076599523,34cyclictest13734-21chrt12:27:523
1076599522,39cyclictest19950-21chrt11:44:503
1076599522,35cyclictest14607-21chrt11:35:423
1076599522,34cyclictest0-21swapper/307:05:423
1076599513,38cyclictest32531-21chrt12:05:463
1076599513,38cyclictest32531-21chrt12:05:463
1076599513,35cyclictest28867-21chrt10:10:493
1076599513,35cyclictest20869-21chrt10:51:013
1076599513,35cyclictest17712-21taskset08:56:003
1076599513,32cyclictest25516-21taskset10:05:303
1076599512,36cyclictest29317-21chrt11:05:483
1076599512,36cyclictest29317-21chrt11:05:483
1076599512,36cyclictest13975-21taskset08:45:523
1076599512,36cyclictest10916-21chrt11:29:383
1076599505,30cyclictest20484-21chrt09:02:573
10765995037,9cyclictest451rcuc/308:00:253
1076599503,36cyclictest11343-21chrt12:24:313
1076599503,36cyclictest11343-21chrt12:24:313
1076599503,34cyclictest4115-21chrt10:23:333
1076599503,34cyclictest21623-21chrt07:30:433
1076599503,34cyclictest19326-21chrt10:49:153
1076599502,35cyclictest3214-21taskset08:11:013
1076599502,35cyclictest3214-21taskset08:11:013
1076599502,35cyclictest11459-21chrt07:00:553
1076599502,34cyclictest25240-21chrt07:40:563
1076599502,34cyclictest1328-21chrt10:19:083
1076599502,31cyclictest25927-21chrt11:00:293
1076599493,34cyclictest536-21chrt11:11:033
1076599493,33cyclictest14521-21chrt10:40:523
1076599493,32cyclictest26499-21chrt07:45:423
1076599493,25cyclictest13659-21chrt10:40:073
1076599492,38cyclictest27691-21chrt09:15:383
1076599492,33cyclictest28255-21chrt07:50:483
10765994835,8cyclictest451rcuc/307:38:133
1076599483,34cyclictest26258-21chrt11:00:453
1076599483,30cyclictest11792-21chrt08:40:293
1076599483,27cyclictest22634-21chrt11:49:043
1076599473,33cyclictest25708-21taskset10:05:423
1076599472,34cyclictest20201-21chrt07:25:493
1076599472,34cyclictest20201-21chrt07:25:493
1076599472,32cyclictest21955-21chrt09:59:303
10765994634,8cyclictest451rcuc/308:29:253
10765994633,8cyclictest451rcuc/308:44:073
10765994633,8cyclictest451rcuc/307:23:313
1076599463,34cyclictest794-21chrt09:25:143
1076599463,34cyclictest794-21chrt09:25:143
1076599463,31cyclictest26963-21chrt09:14:203
1076599462,34cyclictest5299-21taskset08:20:293
1076599462,34cyclictest5299-21taskset08:20:293
1076599462,32cyclictest6021-21chrt08:20:573
1076599462,32cyclictest6021-21chrt08:20:573
10765994330,9cyclictest451rcuc/307:14:123
10765994229,9cyclictest451rcuc/308:08:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional