You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 11:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Mon Jan 12, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1172222100,24sleep00-21swapper/019:09:230
1172222100,24sleep00-21swapper/019:09:230
117759911460,46cyclictest0-21swapper/000:34:370
117759911141,64cyclictest0-21swapper/023:34:210
11784991083,73cyclictest26098-21apt-get22:14:372
117759910633,8cyclictest0-21swapper/023:59:460
117759910633,8cyclictest0-21swapper/023:59:460
11784991052,62cyclictest14946-21apt-get22:50:162
117759910546,50cyclictest0-21swapper/020:24:370
117759910422,19cyclictest0-21swapper/021:31:460
117759910422,19cyclictest0-21swapper/021:31:460
117759910415,27cyclictest21817-21fschecks_count23:54:410
117759910349,47cyclictest0-21swapper/020:39:500
117759910341,56cyclictest15662-21cpuspeed23:44:360
117759910250,45cyclictest0-21swapper/020:04:560
117759910246,51cyclictest11766-21cyclictest22:26:520
117759910240,56cyclictest0-21swapper/022:19:220
117799910146,48cyclictest0-21swapper/119:39:551
117759910140,53cyclictest0-21swapper/021:54:500
117759910050,43cyclictest0-21swapper/023:19:430
11775999935,57cyclictest8369-21ntp_kernel_pll_21:44:480
11779999872,13cyclictest0-21swapper/122:59:231
11775999843,47cyclictest0-21swapper/021:29:240
11775999833,52cyclictest0-21swapper/020:14:230
1178499972,66cyclictest7412-21ssh00:24:352
11779999756,34cyclictest10802-21kernelversion00:29:451
1177599974,27cyclictest1746-21/usr/sbin/munin21:34:440
11775999739,53cyclictest0-21swapper/019:49:480
11775999674,12cyclictest0-21swapper/022:39:550
11775999674,12cyclictest0-21swapper/022:39:550
11775999644,45cyclictest0-21swapper/021:09:530
11775999628,7cyclictest0-21swapper/021:24:210
11775999627,8cyclictest0-21swapper/023:39:410
1177599962,40cyclictest7030-21apt-key00:24:220
1177599962,37cyclictest3427-21run-parts22:29:550
1177599962,37cyclictest3427-21run-parts22:29:550
11775999610,23cyclictest29986-21sh23:14:320
11775999571,12cyclictest0-21swapper/020:49:220
1177599954,27cyclictest10272-21latency_hist00:29:220
11775999530,7cyclictest0-21swapper/000:09:560
1177599952,41cyclictest19442-21wc23:49:540
11779999471,15cyclictest1552-21sh23:19:561
1177599944,25cyclictest15888-21/usr/sbin/munin22:51:130
11775999433,20cyclictest7371-21kworker/u17:2+nfsiod22:13:560
1177599943,31cyclictest4531-21/usr/sbin/munin23:24:570
1177599943,31cyclictest4531-21/usr/sbin/munin23:24:570
1177599943,27cyclictest18382-21grep22:54:430
11775999417,23cyclictest2885-21sh00:16:450
11784999351,38cyclictest11766-21cyclictest21:44:372
11779999374,9cyclictest0-21swapper/119:34:231
11779999372,15cyclictest11766-21cyclictest23:26:391
11779999372,15cyclictest11766-21cyclictest23:26:391
11779999371,14cyclictest0-21swapper/100:19:451
11779999346,40cyclictest10008-21ssh23:34:451
1177599934,25cyclictest16826-21/usr/sbin/munin21:59:530
11775999334,51cyclictest0-21swapper/021:39:480
11775999334,51cyclictest0-21swapper/021:39:480
1177599933,28cyclictest5684-21runrttasks22:34:330
1177599933,27cyclictest10763-21/usr/sbin/munin21:49:360
1177599933,26cyclictest19848-21/usr/sbin/munin22:04:290
1177599933,26cyclictest19848-21/usr/sbin/munin22:04:290
11775999330,8cyclictest0-21swapper/023:14:220
11775999326,7cyclictest0-21swapper/019:09:400
11775999326,7cyclictest0-21swapper/019:09:400
11779999250,35cyclictest0-21swapper/122:29:441
11779999250,35cyclictest0-21swapper/122:29:441
11779999242,43cyclictest5744-21latency_hist20:29:221
11779999238,47cyclictest0-21swapper/123:54:411
1177599924,27cyclictest12443-21/usr/sbin/munin20:50:030
11775999235,50cyclictest0-21swapper/019:15:220
1177599923,30cyclictest4258-21latency_hist20:24:220
1177599923,29cyclictest22022-21/usr/sbin/munin22:59:570
1177599923,26cyclictest18841-21latency_hist21:09:230
1177599923,26cyclictest18841-21latency_hist21:09:230
1177599923,16cyclictest10158-21/usr/sbin/munin23:34:480
1177599922,29cyclictest18197-21sed19:24:560
1177599922,25cyclictest30094-21latency_hist20:04:220
11779999173,9cyclictest0-21swapper/120:20:371
11779999133,8cyclictest0-21swapper/121:27:341
11779999129,8cyclictest0-21swapper/119:49:361
1177599914,27cyclictest15682-21/usr/sbin/munin20:59:430
1177599914,25cyclictest15430-21idleruntime-cro20:59:200
1177599913,28cyclictest23360-21switchtime21:15:440
1177599913,28cyclictest23360-21switchtime21:15:440
1177599913,11cyclictest0-21swapper/022:19:290
11775999126,8cyclictest0-21swapper/020:34:420
1177599912,25cyclictest19461-21/usr/sbin/munin19:29:520
11775999119,20cyclictest12486-21seq00:32:460
1178499902,50cyclictest17251-21apt-get19:24:302
11779999067,13cyclictest0-21swapper/122:39:541
11779999067,13cyclictest0-21swapper/122:39:541
1177999903,23cyclictest2341-21/usr/sbin/munin21:34:491
1177599903,26cyclictest23955-21/usr/sbin/munin23:04:580
1177599903,26cyclictest23955-21/usr/sbin/munin23:04:580
11775999013,21cyclictest28506-21cat00:04:550
115942905,15sleep10-21swapper/119:08:481
115942905,15sleep10-21swapper/119:08:481
1178499893,25cyclictest11967-21apt-get19:09:302
1178499893,25cyclictest11967-21apt-get19:09:302
11779998969,14cyclictest0-21swapper/119:34:421
11779998965,13cyclictest0-21swapper/119:09:351
11779998965,13cyclictest0-21swapper/119:09:351
11779998939,42cyclictest0-21swapper/122:04:471
11779998939,42cyclictest0-21swapper/122:04:471
1177599894,29cyclictest1073-21/usr/sbin/munin20:14:390
1177599894,26cyclictest7458-21latency_hist20:34:220
11775998930,7cyclictest0-21swapper/019:59:210
11775998925,8cyclictest0-21swapper/019:34:460
1177599892,25cyclictest11896-21/usr/sbin/munin22:44:380
1178499883,37cyclictest21682-21/usr/sbin/munin23:54:362
1178499882,36cyclictest14741-21/usr/sbin/munin21:54:542
11779998870,10cyclictest7760-21kworker/u17:1-nfsiod21:14:211
11779998829,9cyclictest0-21swapper/122:44:451
11779998828,8cyclictest0-21swapper/100:39:211
1177599884,25cyclictest22076-21/usr/sbin/munin19:39:430
1177599883,27cyclictest24601-21grep19:44:550
1177599883,26cyclictest16177-21runrttasks19:19:500
11784998748,34cyclictest23677-21kworker/u17:2-rpciod23:14:362
11784998748,32cyclictest0-21swapper/200:12:282
11784998745,36cyclictest11804-21unixbench_multi21:49:552
11784998739,42cyclictest19651-21unixbench_singl23:49:562
1178499873,29cyclictest5032-21fschecks_count21:39:412
1178499873,29cyclictest5032-21fschecks_count21:39:412
1178499872,34cyclictest32213-21needreboot20:09:482
11779998772,8cyclictest0-21swapper/120:44:471
1177999874,28cyclictest25039-21head23:04:571
1177999874,28cyclictest25039-21head23:04:571
11779998732,9cyclictest0-21swapper/121:19:501
11779998730,52cyclictest0-21swapper/120:19:211
1178499862,38cyclictest6901-21dpkg00:24:202
11779998671,8cyclictest0-21swapper/122:04:221
11779998665,10cyclictest0-21swapper/120:04:201
11779998644,35cyclictest0-21swapper/122:18:541
1177999864,39cyclictest14072-21apt-get20:54:321
11779998636,43cyclictest0-21swapper/121:54:221
11784998564,14cyclictest2535-21latency_hist22:29:222
11784998543,36cyclictest18656-21diskmemload23:19:442
11784998540,38cyclictest0-21swapper/220:44:522
11784998534,44cyclictest297-21systemd-logind21:39:202
1178499853,37cyclictest9857-21/usr/sbin/munin20:39:542
1178499853,35cyclictest352-21runrttasks19:19:562
1178499853,33cyclictest17927-21/usr/sbin/munin21:04:522
1178499853,33cyclictest17927-21/usr/sbin/munin21:04:522
11779998537,41cyclictest0-21swapper/121:15:071
11779998537,41cyclictest0-21swapper/121:15:071
11779998531,9cyclictest0-21swapper/123:49:221
11779998524,11cyclictest0-21swapper/122:29:221
11784998443,35cyclictest17976-21sh22:00:012
1178499843,36cyclictest6441-21/usr/sbin/munin22:34:562
1178499843,34cyclictest3547-21munin-node23:24:302
1178499843,34cyclictest3547-21munin-node23:24:302
11779998462,12cyclictest0-21swapper/123:09:511
1177999844,34cyclictest6570-21ssh23:29:321
11779998441,36cyclictest0-21swapper/120:04:531
1177999843,26cyclictest21124-21ssh22:59:361
11779998429,11cyclictest0-21swapper/120:29:481
11779998426,7cyclictest0-21swapper/100:12:191
11779998425,7cyclictest0-21swapper/122:09:531
11784998334,41cyclictest0-21swapper/219:54:232
1178499833,36cyclictest5341-21cron22:34:192
1178499833,36cyclictest5341-21cron22:34:192
1178499833,36cyclictest27251-21/usr/sbin/munin19:54:432
1178499833,35cyclictest20976-21ssh22:59:302
1178499833,33cyclictest23898-21cut19:44:402
1178499833,32cyclictest8900-21diskstats22:39:392
1178499833,32cyclictest8900-21diskstats22:39:392
1178499832,32cyclictest13356-21/usr/sbin/munin00:34:292
1177999834,25cyclictest5657-21/usr/sbin/munin22:34:381
1177999833,29cyclictest25616-21ssh23:59:571
1177999833,29cyclictest25616-21ssh23:59:571
1177999833,27cyclictest31850-21latency_hist22:24:221
11779998331,8cyclictest0-21swapper/121:39:521
11779998331,8cyclictest0-21swapper/121:39:521
11779998330,9cyclictest0-21swapper/123:39:451
1177999832,27cyclictest16210-21mailstats22:51:231
1179399829,48cyclictest0-21swapper/322:49:453
1178499823,56cyclictest18656-21diskmemload00:30:042
1178499823,39cyclictest23468-21unin-run19:44:202
1178499823,35cyclictest7712-21/usr/sbin/munin20:34:382
1178499823,34cyclictest20686-21modprobe22:59:202
1178499823,31cyclictest19911-21sed21:09:542
1178499823,28cyclictest14592-21/usr/sbin/munin20:54:492
1177999823,24cyclictest18683-21idleruntime-cro21:09:191
1177999823,24cyclictest18683-21idleruntime-cro21:09:191
11779998229,8cyclictest0-21swapper/120:34:581
11784998141,34cyclictest18656-21diskmemload23:37:062
11784998138,37cyclictest30975-21sh22:22:012
1178499813,48cyclictest22231-21apt-get21:14:372
1178499813,48cyclictest22231-21apt-get21:14:372
1178499813,38cyclictest352-21runrttasks22:09:402
1178499813,35cyclictest29167-21/usr/sbin/munin19:59:532
1178499813,32cyclictest30923-21apt21:29:192
1178499812,37cyclictest24174-21ssh23:04:402
1178499812,37cyclictest24174-21ssh23:04:402
11779998164,8cyclictest0-21swapper/121:49:221
11779998161,14cyclictest297-21systemd-logind00:19:191
1177999814,29cyclictest17231-21/usr/sbin/munin19:24:521
1177999814,28cyclictest17134-21grep21:04:211
1177999813,28cyclictest6834-21apt-get00:24:321
1177999813,28cyclictest14983-21grep19:15:071
1177999813,26cyclictest27565-21/usr/sbin/munin00:04:521
1178499804,30cyclictest11807-21/usr/sbin/munin22:44:372
11784998035,38cyclictest26776-21sh00:02:562
11784998035,38cyclictest26776-21sh00:02:562
1178499803,34cyclictest7114-21/usr/sbin/munin23:29:482
1178499803,32cyclictest277-21dbus-daemon21:34:202
1178499803,32cyclictest277-21dbus-daemon21:34:202
1178499803,25cyclictest28130-21/usr/sbin/munin00:04:472
11784998027,46cyclictest27923-21latency_hist21:24:212
1178499802,35cyclictest3226-21/usr/sbin/munin20:20:412
11779998061,12cyclictest0-21swapper/120:14:211
11779998057,13cyclictest0-21swapper/121:54:341
1177999804,26cyclictest10148-21unixbench_multi20:39:581
1177999803,29cyclictest16636-21/usr/sbin/munin19:19:591
1177999803,24cyclictest12729-21grep20:49:471
11779998025,8cyclictest0-21swapper/123:49:371
11779998024,8cyclictest0-21swapper/121:29:471
11779998024,8cyclictest0-21swapper/121:29:471
11784997935,38cyclictest0-21swapper/220:19:242
1178499793,31cyclictest27631-21/usr/sbin/munin23:09:502
1178499793,26cyclictest16695-21/usr/sbin/munin23:44:582
1178499792,33cyclictest3889-21seq00:19:202
1178499792,32cyclictest17028-21taskset21:04:142
1178499792,31cyclictest7042-21taskset20:30:342
1178499792,25cyclictest21083-21grep19:34:532
1177999794,24cyclictest23962-21fschecks_time19:44:411
1178499783,34cyclictest4911-21/usr/sbin/munin20:24:492
1178499783,32cyclictest21522-21sh22:06:322
1178499783,32cyclictest21522-21sh22:06:322
1178499783,31cyclictest13802-21cron20:54:192
1178499782,36cyclictest19644-21/usr/sbin/munin19:29:552
1178499782,30cyclictest13689-21taskset19:14:272
1177999784,34cyclictest27060-21/usr/sbin/munin19:54:381
11779997819,23cyclictest29996-21sh23:14:341
1178499773,27cyclictest12788-21/usr/sbin/munin23:39:402
1178499772,29cyclictest31000-21cat20:04:562
104732769,45sleep210479-21/usr/sbin/munin19:04:452
104732769,45sleep210479-21/usr/sbin/munin19:04:452
1179399714,52cyclictest26134-21chrt22:14:373
227602690,6sleep30-21swapper/319:39:523
1179399673,49cyclictest28637-21chrt21:24:433
1179399672,53cyclictest23398-21taskset22:09:473
1179399664,31cyclictest0-21swapper/321:14:443
1179399664,31cyclictest0-21swapper/321:14:443
1179399663,48cyclictest25240-21chrt23:05:243
1179399663,48cyclictest25240-21chrt23:05:243
1179399662,50cyclictest13251-21taskset19:13:473
1179399662,50cyclictest13251-21taskset19:13:473
1179399653,50cyclictest30639-21chrt00:09:343
1179399653,49cyclictest2825-21chrt20:19:493
1179399653,49cyclictest23027-21chrt23:02:363
1179399653,48cyclictest20256-21taskset22:58:183
1179399653,48cyclictest18232-21taskset19:24:573
1179399653,48cyclictest12982-21taskset23:39:443
1179399653,48cyclictest10460-21chrt20:42:543
1179399652,49cyclictest26355-21taskset19:50:453
1119726514,33sleep30-21swapper/319:05:073
1119726514,33sleep30-21swapper/319:05:073
67492640,15sleep3451rcuc/323:29:393
1179399643,49cyclictest26735-21chrt00:02:503
1179399643,49cyclictest26735-21chrt00:02:503
1179399643,49cyclictest25219-21chrt21:19:283
1179399643,48cyclictest7333-21taskset22:36:303
1179399643,48cyclictest5091-21taskset22:33:383
1179399643,48cyclictest5091-21taskset22:33:383
1179399643,46cyclictest15067-21taskset20:55:013
1179399642,49cyclictest26886-21chrt19:54:263
1179399642,49cyclictest11805-21chrt00:30:503
1179399642,48cyclictest29737-21taskset20:02:283
1179399639,31cyclictest0-21swapper/300:24:483
1179399633,48cyclictest31422-21taskset22:23:173
1179399633,48cyclictest13017-21taskset22:45:303
1179399633,48cyclictest11046-21chrt22:43:233
1179399633,48cyclictest11046-21chrt22:43:233
1179399632,49cyclictest17466-21chrt21:59:503
1179399632,48cyclictest24502-21chrt19:44:543
1179399632,48cyclictest21653-21taskset21:14:173
1179399632,48cyclictest2142-21chrt23:21:163
1179399623,47cyclictest5860-21chrt23:28:173
1179399623,47cyclictest5860-21chrt23:28:173
1179399623,46cyclictest28569-21taskset23:11:193
1179399623,45cyclictest566-21chrt20:13:293
1179399623,45cyclictest21515-21chrt19:35:473
1179399623,45cyclictest0-21swapper/322:24:313
1179399622,47cyclictest4403-21taskset20:24:313
1179399622,47cyclictest32516-21chrt21:30:273
1179399622,47cyclictest32516-21chrt21:30:273
1179399622,47cyclictest17282-21chrt23:46:373
1179399622,46cyclictest11593-21chrt23:37:333
1179399613,46cyclictest7242-21chrt20:33:103
1179399613,46cyclictest6495-21taskset21:41:383
1179399613,46cyclictest6495-21taskset21:41:383
1179399613,46cyclictest23507-21chrt23:57:193
1179399613,45cyclictest18474-21chrt21:07:083
1179399613,45cyclictest18474-21chrt21:07:083
1179399613,45cyclictest0-21swapper/300:19:333
1179399612,47cyclictest8919-21chrt20:39:053
1179399612,47cyclictest29539-21chrt00:07:203
1179399612,46cyclictest20028-21chrt19:32:183
1179399612,46cyclictest15653-21chrt19:19:353
1179399612,45cyclictest1954-21taskset00:14:533
1179399603,46cyclictest18585-21chrt23:49:323
1179399603,45cyclictest11422-21chrt21:49:493
1179399602,46cyclictest20005-21chrt22:04:363
1179399602,46cyclictest20005-21chrt22:04:363
1179399602,45cyclictest30696-21chrt20:04:513
1179399602,45cyclictest16695-21taskset20:59:593
1179399602,45cyclictest15577-21chrt21:56:463
1179399602,44cyclictest14558-21chrt19:15:013
1179399593,44cyclictest13111-21chrt20:49:593
1179399593,42cyclictest29914-21chrt23:14:233
1179399592,45cyclictest9540-21chrt21:46:453
1179399583,40cyclictest0-21swapper/320:44:343
1179399574,41cyclictest0-21swapper/321:34:313
1179399572,45cyclictest0-21swapper/300:34:343
1179399553,43cyclictest1914-21chrt20:15:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional