You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 09:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Wed Apr 15, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
247021860,22sleep00-21swapper/018:58:530
32529911153,50cyclictest0-21swapper/219:03:142
290621066,18sleep10-21swapper/119:00:391
3252991055,40cyclictest5085-21ssh00:28:222
32529910450,46cyclictest13958-21idleruntime-cro22:03:092
32529910135,29cyclictest13504-21cron19:33:102
3252999951,12cyclictest181rcu_preempt22:07:432
3252999951,12cyclictest181rcu_preempt22:07:432
3252999842,12cyclictest17212-21open_files23:54:222
3252999842,12cyclictest17212-21open_files23:54:222
3237999772,19cyclictest25920-21runrttasks20:08:460
3237999772,19cyclictest25920-21runrttasks20:08:460
316872970,8sleep10-21swapper/100:18:331
325299964,40cyclictest31694-21latency_hist20:28:122
325299964,37cyclictest352-21runrttasks22:58:372
325299964,37cyclictest352-21runrttasks22:58:372
325299963,45cyclictest26393-21grep00:08:462
3252999634,10cyclictest0-21swapper/222:30:022
325299962,38cyclictest9272-21timerwakeupswit21:53:462
3252999563,23cyclictest6803-21cron19:13:102
325299954,34cyclictest23610-21switchtime21:23:462
325299954,33cyclictest5022-21munin-node22:13:202
3252999542,45cyclictest0-21swapper/200:18:372
3252999535,9cyclictest0-21swapper/221:13:382
325299953,34cyclictest10445-21ssh22:49:272
325299952,36cyclictest20492-21ssh21:18:442
3252999447,40cyclictest0-21swapper/200:24:462
325299943,42cyclictest19397-21ssh23:03:472
325299943,42cyclictest19397-21ssh23:03:472
3252999433,13cyclictest0-21swapper/220:38:102
325299942,41cyclictest25047-21rm00:08:102
3237999451,32cyclictest0-21swapper/019:13:310
325299934,41cyclictest352-21runrttasks21:43:412
3252999342,43cyclictest0-21swapper/220:08:122
3252999336,50cyclictest0-21swapper/219:43:252
325299933,39cyclictest31567-21sh21:38:122
325299933,33cyclictest3938-21latency_hist20:43:122
325299933,32cyclictest14124-21unixbench_multi23:48:472
325299924,39cyclictest15192-21latency_hist22:58:122
325299924,32cyclictest11010-21fschecks_time21:03:332
325299923,41cyclictest22066-21latency_hist00:03:112
325299923,35cyclictest21778-21latency_hist19:58:122
325299923,35cyclictest21778-21latency_hist19:58:122
3252999227,11cyclictest0-21swapper/222:43:462
3252999227,11cyclictest0-21swapper/222:43:462
3237999272,12cyclictest0-21swapper/022:58:430
3237999272,12cyclictest0-21swapper/022:58:430
3237999271,10cyclictest0-21swapper/022:29:230
3252999164,20cyclictest23741-21kworker/u18:2+flush-179:019:23:372
325299914,33cyclictest5792-21/usr/sbin/munin20:48:302
325299914,30cyclictest10204-21latency_hist19:23:122
325299913,37cyclictest29440-21ssh00:13:472
325299913,37cyclictest25146-21taskset23:14:272
3252999133,11cyclictest0-21swapper/221:28:482
3252999127,13cyclictest0-21swapper/220:08:432
3252999127,13cyclictest0-21swapper/220:08:432
325299912,36cyclictest26750-21cpu20:13:262
325299912,36cyclictest26750-21cpu20:13:262
323799913,45cyclictest24601-21apt-get23:13:240
325299905,31cyclictest352-21runrttasks19:03:262
325299904,32cyclictest352-21runrttasks19:33:222
325299903,36cyclictest10368-21fschecks_time23:43:292
325299903,33cyclictest20030-21latency_hist22:13:112
325299903,31cyclictest8783-21modprobe20:58:102
3252999027,10cyclictest0-21swapper/219:13:212
3241999067,13cyclictest0-21swapper/120:18:111
3241999067,13cyclictest0-21swapper/120:18:111
3237999070,13cyclictest2952-21systemd-journal21:42:320
3237999070,13cyclictest2952-21systemd-journal21:42:320
325299894,38cyclictest1065-21/usr/sbin/munin23:28:562
325299893,36cyclictest22036-21grep23:08:442
325299893,35cyclictest31751-21acpi21:38:202
325299893,35cyclictest31751-21acpi21:38:202
325299893,33cyclictest13873-21cstates21:08:292
325299893,33cyclictest13873-21cstates21:08:292
3252998927,19cyclictest0-21swapper/220:28:362
3252998925,13cyclictest0-21swapper/222:42:322
3252998925,13cyclictest0-21swapper/222:42:322
325299892,35cyclictest4425-21fschecks_time20:43:322
3241998969,13cyclictest0-21swapper/121:58:131
3241998965,16cyclictest2952-21systemd-journal20:01:321
3241998965,11cyclictest0-21swapper/120:08:121
3237998967,12cyclictest0-21swapper/019:38:270
323799893,47cyclictest352-21runrttasks23:54:100
323799893,47cyclictest352-21runrttasks23:54:100
325299884,37cyclictest352-21runrttasks23:36:542
325299884,37cyclictest23396-21latency_hist20:03:122
325299884,35cyclictest18852-21fschecks_time19:48:312
3252998835,10cyclictest0-21swapper/223:40:132
3252998835,10cyclictest0-21swapper/223:40:132
325299883,38cyclictest27555-21/usr/sbin/munin23:18:252
325299883,38cyclictest23519-21uniq22:18:312
325299883,33cyclictest29935-21latency_hist20:23:122
325299883,25cyclictest26540-21rm22:23:332
3241998872,9cyclictest12214-21sh22:53:131
3241998861,18cyclictest28047-21latency23:18:351
3241998847,28cyclictest31521-21modprobe20:28:091
325299874,32cyclictest30968-21ssh23:23:332
3241998766,11cyclictest0-21swapper/119:53:131
3241998764,13cyclictest0-21swapper/121:58:261
325299865,34cyclictest15926-21ntp_kernel_pll_19:38:382
325299864,33cyclictest32409-21/usr/sbin/munin22:33:362
325299863,36cyclictest6004-21ssh21:48:432
325299863,31cyclictest10653-21ssh21:03:142
3241998546,13cyclictest181rcu_preempt19:18:321
3241998466,9cyclictest0-21swapper/121:08:351
3241998466,9cyclictest0-21swapper/121:08:351
3241998463,10cyclictest0-21swapper/119:18:121
3241998462,16cyclictest6436-21cat22:43:351
3241998462,16cyclictest6436-21cat22:43:351
3237998462,15cyclictest3228-21cyclictest00:25:370
3237998455,20cyclictest12914-21latency_hist23:48:120
3241998360,15cyclictest6118-21sh00:28:451
3237998361,11cyclictest0-21swapper/022:49:180
3237998355,23cyclictest0-21swapper/021:23:460
3241998264,11cyclictest0-21swapper/119:08:341
3237998262,9cyclictest0-21swapper/019:58:330
3241998160,11cyclictest0-21swapper/120:23:121
3241998159,11cyclictest0-21swapper/119:48:121
3241998156,13cyclictest0-21swapper/119:23:511
3241998155,13cyclictest0-21swapper/120:53:131
3237998160,12cyclictest0-21swapper/020:43:450
3237998143,31cyclictest4772-21apt19:08:100
3241998059,16cyclictest352-21runrttasks23:55:431
3241998059,16cyclictest352-21runrttasks23:55:431
3237998044,25cyclictest0-21swapper/022:23:270
3237998014,31cyclictest3179-21ssh21:43:450
3237998011,46cyclictest170-21jbd2/mmcblk2p2-823:33:240
325899793,59cyclictest25222-21taskset23:14:283
3241997959,12cyclictest10418-21diskmemload23:16:321
3241997956,13cyclictest0-21swapper/120:48:121
3237997957,12cyclictest0-21swapper/021:28:430
3237997954,12cyclictest0-21swapper/021:03:130
3237997858,11cyclictest0-21swapper/023:23:380
3237997818,22cyclictest0-21swapper/023:28:130
3237997759,8cyclictest0-21swapper/019:43:300
3237997751,17cyclictest31082-21latency_hist00:18:110
3237997725,10cyclictest0-21swapper/019:28:120
3241997660,10cyclictest10417-21kworker/u18:121:03:101
3237997657,12cyclictest22468-21ssh00:03:280
3237997656,14cyclictest3228-21cyclictest21:54:500
3237997645,20cyclictest12469-21taskset22:53:310
324199759,33cyclictest0-21swapper/122:18:091
3241997557,11cyclictest0-21swapper/123:48:111
3241997557,10cyclictest0-21swapper/123:13:131
3241997553,12cyclictest0-21swapper/121:33:251
3241997528,35cyclictest3798-21switchtime22:38:451
3241997528,35cyclictest3798-21switchtime22:38:451
3241997528,10cyclictest0-21swapper/120:38:321
3237997557,10cyclictest0-21swapper/023:53:140
3237997543,22cyclictest13705-21latency_hist19:33:130
3241997455,10cyclictest0-21swapper/120:58:121
3241997452,15cyclictest31132-21ssh00:18:121
3237997450,17cyclictest0-21swapper/000:33:110
3237997450,14cyclictest29348-21ntp_kernel_pll_21:33:370
323799744,60cyclictest14236-21/usr/sbin/munin22:03:330
323799744,60cyclictest14236-21/usr/sbin/munin22:03:330
325899733,54cyclictest21409-21taskset21:20:183
3241997354,13cyclictest25446-21latency_hist21:28:131
324199734,52cyclictest2112-21ssh00:23:241
3237997354,11cyclictest0-21swapper/020:53:120
3237997352,12cyclictest0-21swapper/020:33:470
3237997351,12cyclictest0-21swapper/022:22:500
3237997321,35cyclictest0-21swapper/021:08:430
3237997321,35cyclictest0-21swapper/021:08:430
3237997311,15cyclictest0-21swapper/019:23:140
325899723,56cyclictest5976-21chrt22:43:243
325899723,56cyclictest5976-21chrt22:43:243
325899722,38cyclictest26766-21taskset21:28:493
324199728,24cyclictest12741-21proc_pri19:28:421
3241997250,10cyclictest0-21swapper/123:03:311
3241997250,10cyclictest0-21swapper/123:03:311
3241997246,18cyclictest32066-21fschecks_time20:28:331
3237997255,10cyclictest297-21systemd-logind22:03:100
3237997254,12cyclictest7951-21cron21:53:090
3237997254,11cyclictest0-21swapper/020:13:560
3237997254,11cyclictest0-21swapper/020:13:560
3237997251,11cyclictest0-21swapper/023:03:250
3237997251,11cyclictest0-21swapper/023:03:250
323799722,34cyclictest19920-21latency_hist22:13:120
3237997214,40cyclictest0-21swapper/021:19:450
3237997210,22cyclictest24065-21ps20:03:420
325899713,55cyclictest2018-21chrt21:43:113
325899713,55cyclictest2018-21chrt21:43:113
325899712,36cyclictest4189-21chrt21:45:593
3241997153,9cyclictest0-21swapper/123:58:341
3241997117,10cyclictest0-21swapper/121:48:121
323799719,25cyclictest2994-21ssh22:38:260
323799719,25cyclictest2994-21ssh22:38:260
3237997155,11cyclictest0-21swapper/021:07:080
3237997154,9cyclictest0-21swapper/020:23:100
3237997152,12cyclictest28144-21ntp_kernel_err23:18:370
3237997144,19cyclictest19310-21/usr/sbin/munin23:58:420
3237997118,14cyclictest888-21date20:33:130
325899703,54cyclictest29457-21chrt22:28:253
325899703,35cyclictest13106-21chrt23:48:243
325899702,56cyclictest2847-21taskset20:38:333
3241997050,10cyclictest0-21swapper/123:43:121
3241997050,10cyclictest0-21swapper/123:43:121
3241997049,14cyclictest2952-21systemd-journal22:10:321
324199704,28cyclictest32648-21ssh22:33:311
3237997057,7cyclictest0-21swapper/023:43:120
3237997057,7cyclictest0-21swapper/023:43:120
3237997055,9cyclictest3177-21processes20:38:430
3237997054,8cyclictest0-21swapper/021:13:280
323799704,45cyclictest13793-21/usr/sbin/munin19:33:380
325899693,54cyclictest5300-21taskset21:48:223
325899693,53cyclictest30194-21chrt20:23:233
325899692,35cyclictest29029-21chrt21:33:313
3241996951,9cyclictest0-21swapper/121:53:121
3241996950,10cyclictest0-21swapper/121:14:331
3241996949,10cyclictest0-21swapper/119:38:321
3237996947,9cyclictest0-21swapper/020:28:130
323799693,53cyclictest1581-21ssh22:35:130
3237996913,22cyclictest21375-21/usr/sbin/munin22:13:480
325899683,52cyclictest12753-21chrt22:54:183
325899683,51cyclictest24113-21chrt22:18:443
325899682,54cyclictest23108-21taskset00:03:443
325899682,35cyclictest20455-21taskset23:06:343
325899682,35cyclictest20455-21taskset23:06:343
3241996854,8cyclictest0-21swapper/121:18:421
3241996852,10cyclictest28064-21systemd-run00:13:111
3241996848,10cyclictest0-21swapper/122:58:271
3241996848,10cyclictest0-21swapper/122:58:271
3237996855,9cyclictest3228-21cyclictest19:12:340
3237996838,21cyclictest20031-21systemctl19:53:110
325899674,50cyclictest12596-21chrt19:28:363
325899674,50cyclictest0-21swapper/300:23:253
325899673,33cyclictest17264-21chrt22:08:233
325899672,52cyclictest21389-21chrt22:13:503
325899672,51cyclictest8461-21taskset23:39:293
325899672,51cyclictest8461-21taskset23:39:293
325899672,33cyclictest23252-21chrt23:11:003
3241996753,9cyclictest31585-21unixbench_multi23:23:471
3241996750,12cyclictest3228-21cyclictest21:03:491
3241996750,10cyclictest0-21swapper/122:23:511
3241996749,9cyclictest0-21swapper/123:33:001
324199674,44cyclictest15155-21latency_hist19:38:131
323799676,34cyclictest6886-21timerwakeupswit22:43:450
323799676,34cyclictest6886-21timerwakeupswit22:43:450
3237996750,8cyclictest0-21swapper/000:18:350
3237996747,12cyclictest23465-21ssh23:11:360
325899664,48cyclictest1710-21chrt23:28:393
325899663,52cyclictest18923-21chrt19:48:323
325899663,50cyclictest11741-21chrt21:58:353
325899663,49cyclictest26947-21chrt00:10:123
325899663,46cyclictest0-21swapper/319:43:213
325899663,29cyclictest18595-21chrt21:15:483
325899662,53cyclictest10565-21chrt19:23:213
325899662,51cyclictest30928-21chrt00:17:583
325899662,51cyclictest20664-21taskset23:59:263
325899662,50cyclictest6421-21taskset20:48:423
325899662,50cyclictest10013-21chrt22:49:203
325899662,33cyclictest28257-21chrt23:18:423
3241996653,7cyclictest0-21swapper/122:54:451
3241996652,8cyclictest0-21swapper/100:03:321
3241996652,7cyclictest0-21swapper/122:28:141
3241996651,8cyclictest0-21swapper/120:13:121
3241996651,8cyclictest0-21swapper/120:13:121
3241996649,8cyclictest0-21swapper/123:33:511
3241996648,11cyclictest0-21swapper/121:28:351
3241996624,7cyclictest301ktimers/119:08:121
3237996651,9cyclictest26191-21ssh00:08:450
3237996651,8cyclictest0-21swapper/019:53:450
3237996651,8cyclictest0-21swapper/019:53:450
325899654,46cyclictest0-21swapper/319:33:223
325899653,49cyclictest26828-21taskset20:13:273
325899653,49cyclictest26828-21taskset20:13:273
325899653,36cyclictest4475-21chrt22:39:563
325899653,36cyclictest4475-21chrt22:39:563
325899653,35cyclictest24666-21chrt21:26:013
325899653,31cyclictest2055-21chrt20:34:533
325899652,51cyclictest1228-21chrt22:34:123
325899652,50cyclictest16374-21chrt22:06:373
325899652,50cyclictest16374-21chrt22:06:373
325899652,33cyclictest32257-21taskset23:25:273
325899652,33cyclictest11852-21chrt23:45:363
325899652,32cyclictest6308-21chrt00:29:093
325899652,32cyclictest17364-21chrt23:01:153
325899652,32cyclictest17364-21chrt23:01:153
325899652,31cyclictest21376-21taskset19:55:163
325899652,31cyclictest21376-21taskset19:55:163
3241996550,8cyclictest0-21swapper/122:03:411
3241996550,8cyclictest0-21swapper/122:03:411
3241996547,8cyclictest0-21swapper/121:38:321
3241996547,8cyclictest0-21swapper/121:38:321
324199653,42cyclictest25903-21latency_hist22:23:111
325899645,43cyclictest0-21swapper/319:03:243
325899644,30cyclictest9880-21chrt19:20:583
325899643,49cyclictest32248-21chrt20:28:373
325899643,47cyclictest0-21swapper/319:08:253
325899643,31cyclictest6310-21chrt23:36:493
325899642,51cyclictest26425-21chrt22:23:303
325899642,49cyclictest405-21chrt00:20:013
325899642,49cyclictest29360-21chrt20:19:053
325899642,33cyclictest10465-21chrt21:56:443
325899642,31cyclictest5216-21chrt20:44:043
325899642,31cyclictest23110-21chrt20:01:523
325899642,30cyclictest24532-21chrt20:04:323
3241996451,7cyclictest0-21swapper/123:48:341
325899633,48cyclictest18842-21chrt23:57:443
325899633,48cyclictest18842-21chrt23:57:443
325899632,30cyclictest26226-21chrt20:10:313
325899632,30cyclictest26226-21chrt20:10:313
324199634,39cyclictest21606-21modprobe19:58:091
324199634,39cyclictest21606-21modprobe19:58:091
323799632,44cyclictest352-21runrttasks20:54:390
178326325,23sleep30-21swapper/318:58:283
325899623,48cyclictest14962-21chrt21:09:073
325899623,48cyclictest14962-21chrt21:09:073
325899623,46cyclictest12361-21taskset21:05:143
325899623,29cyclictest10147-21chrt21:00:043
3241996240,12cyclictest0-21swapper/120:33:271
325899613,46cyclictest7423-21chrt20:53:193
325899613,44cyclictest16578-21taskset19:40:593
325899612,28cyclictest8117-21chrt19:13:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional