You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 04:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Dec 10, 2025 00:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
307539912648,14cyclictest30740-21cyclictest22:28:420
307539912648,14cyclictest30740-21cyclictest22:28:420
29445212212,71sleep229501-21fschecks_time19:03:412
307539912046,13cyclictest0-21swapper/023:23:500
307539912046,13cyclictest0-21swapper/023:23:500
307539911748,13cyclictest1277-21timerandwakeup19:13:500
307539911748,13cyclictest1277-21timerandwakeup19:13:500
307539911650,14cyclictest207-21systemd-journal22:50:260
307539910850,13cyclictest6181-21sh21:08:450
307539910644,12cyclictest30251-21sh23:38:240
30753991053,27cyclictest207-21systemd-journal23:00:260
30753991053,27cyclictest207-21systemd-journal23:00:260
307699910138,14cyclictest0-21swapper/222:38:152
30769999740,10cyclictest10731-21timerwakeupswit23:04:472
30769999740,10cyclictest10731-21timerwakeupswit23:04:472
30769999740,10cyclictest0-21swapper/220:18:142
30769999638,8cyclictest0-21swapper/222:13:452
30769999638,8cyclictest0-21swapper/222:13:452
30769999638,12cyclictest23892-21latency_hist23:28:142
30769999638,12cyclictest23892-21latency_hist23:28:142
30753999467,20cyclictest13613-21latency_hist19:53:150
30769999335,12cyclictest0-21swapper/220:53:522
30761999131,7cyclictest181rcu_preempt21:58:151
30761999131,7cyclictest181rcu_preempt21:58:151
30769999042,10cyclictest30740-21cyclictest23:55:162
30769999037,13cyclictest11747-21sh21:18:242
3059428915,46sleep130614-21apt19:08:131
30753998865,16cyclictest9745-21ssh21:14:310
30753998642,33cyclictest17736-21kworker/u17:0+nfsiod00:21:300
30761998565,11cyclictest0-21swapper/121:43:151
30761998544,8cyclictest181rcu_preempt22:38:261
30753998457,19cyclictest27978-21sh00:28:390
30753998457,19cyclictest27978-21sh00:28:390
30761998361,14cyclictest5226-21diskmemload21:26:041
30769998251,23cyclictest7104-21threads22:58:482
30769998251,23cyclictest7104-21threads22:58:482
30769998250,23cyclictest25176-21cut20:28:332
30753998256,7cyclictest181rcu_preempt00:06:320
30753998256,7cyclictest181rcu_preempt00:06:320
30753998239,8cyclictest181rcu_preempt19:33:410
2982928215,43sleep029858-21ps19:03:560
30769998158,16cyclictest30740-21cyclictest19:29:262
30769998156,16cyclictest355-21runrttasks00:24:052
30761998164,9cyclictest0-21swapper/119:43:451
30761998164,9cyclictest0-21swapper/119:43:451
30761998160,11cyclictest0-21swapper/122:18:491
30761998140,16cyclictest58-21kcompactd019:53:331
30769998058,16cyclictest18925-21latency20:08:412
30769998058,16cyclictest18925-21latency20:08:412
3076999802,41cyclictest9821-21apt-get23:58:312
30761998062,11cyclictest0-21swapper/121:48:151
30761998059,10cyclictest0-21swapper/121:03:341
30761997963,9cyclictest0-21swapper/121:14:301
30761997960,9cyclictest0-21swapper/100:28:441
30761997960,9cyclictest0-21swapper/100:28:441
30761997938,19cyclictest31647-21ssh00:34:401
30753997961,13cyclictest30740-21cyclictest22:39:060
30753997959,13cyclictest19208-21rm00:13:410
30753997950,7cyclictest0-21swapper/021:58:480
30769997848,23cyclictest24361-21latency_hist00:23:142
30769997842,13cyclictest181rcu_preempt23:12:152
30753997860,9cyclictest0-21swapper/021:28:290
30753997860,9cyclictest0-21swapper/021:28:290
30753997856,11cyclictest0-21swapper/000:38:140
30753997855,7cyclictest929950mandb23:58:130
30753997850,11cyclictest314-21in:imuxsock21:53:130
30753997840,8cyclictest0-21swapper/021:43:420
30769997758,14cyclictest11804-21latency_hist19:48:152
30769997745,13cyclictest9516-21ssh21:14:242
30761997758,8cyclictest0-21swapper/123:34:371
30761997758,13cyclictest314-21in:imuxsock19:53:121
30753997748,18cyclictest5403-21latency_hist21:08:160
30769997650,8cyclictest181rcu_preempt22:33:132
30769997650,8cyclictest181rcu_preempt22:33:132
30761997659,10cyclictest0-21swapper/123:08:481
30761997658,9cyclictest0-21swapper/122:53:141
30753997655,10cyclictest0-21swapper/020:18:150
30753997653,16cyclictest30740-21cyclictest00:11:430
30753997651,14cyclictest0-21swapper/023:18:300
30753997645,24cyclictest0-21swapper/022:48:040
30753997645,24cyclictest0-21swapper/022:48:040
30753997630,7cyclictest0-21swapper/023:13:250
30769997543,24cyclictest5104-21latency_hist19:28:162
30761997560,8cyclictest0-21swapper/123:48:401
30761997555,10cyclictest0-21swapper/122:34:221
30761997535,8cyclictest0-21swapper/123:23:361
30761997535,8cyclictest0-21swapper/123:23:361
30753997560,11cyclictest0-21swapper/020:03:140
30753997556,13cyclictest1341-21ntpq23:43:410
30769997454,14cyclictest207-21systemd-journal19:13:132
30769997453,12cyclictest0-21swapper/220:58:352
30761997458,9cyclictest0-21swapper/100:13:331
30761997455,9cyclictest0-21swapper/123:08:151
30761997455,9cyclictest0-21swapper/123:08:151
30761997454,10cyclictest0-21swapper/121:10:051
30753997457,8cyclictest0-21swapper/020:43:470
30753997457,8cyclictest0-21swapper/020:43:470
30753997454,13cyclictest11925-21latency_hist19:48:140
30753997454,13cyclictest11925-21latency_hist19:48:140
30753997454,12cyclictest11198-21sh23:05:520
30753997454,12cyclictest11198-21sh23:05:520
30753997453,7cyclictest181rcu_preempt20:18:350
30753997451,15cyclictest27984-21sendmail20:38:120
30753997439,7cyclictest181rcu_preempt20:38:440
30753997429,8cyclictest181rcu_preempt00:27:110
30769997341,7cyclictest0-21swapper/221:27:262
30769997329,31cyclictest5293-21sh23:50:162
30769997316,47cyclictest29633-21diskmemload22:43:272
30769997316,47cyclictest29633-21diskmemload22:43:272
30753997357,9cyclictest0-21swapper/023:59:100
30753997354,9cyclictest0-21swapper/021:03:150
30753997353,14cyclictest20777-21ssh21:33:340
30753997341,21cyclictest27377-21ssh23:33:370
30769997251,13cyclictest3763-21diskmemload21:58:452
30769997250,14cyclictest26195-21kworker/u17:2-nfsiod23:34:342
30769997245,19cyclictest11900-21latency_hist19:48:142
30769997243,21cyclictest6792-21mailstats22:03:472
30769997243,21cyclictest6792-21mailstats22:03:472
30761997255,8cyclictest0-21swapper/100:18:271
30761997255,11cyclictest292-21dbus-daemon23:03:131
30761997255,11cyclictest292-21dbus-daemon23:03:131
30761997247,16cyclictest32495-21latency_hist22:48:141
30761997247,16cyclictest32495-21latency_hist22:48:141
30753997256,9cyclictest0-21swapper/022:23:310
30753997256,9cyclictest0-21swapper/022:23:310
30753997243,7cyclictest181rcu_preempt20:33:140
30769997150,11cyclictest0-21swapper/221:48:492
30769997147,14cyclictest0-21swapper/200:28:322
30769997147,14cyclictest0-21swapper/200:28:322
30769997146,15cyclictest0-21swapper/220:23:512
30761997154,11cyclictest12690-21cpu00:03:331
30761997126,9cyclictest181rcu_preempt21:38:151
30753997147,15cyclictest5226-21diskmemload21:38:470
30753997145,7cyclictest181rcu_preempt22:13:140
30769997043,19cyclictest6417-21threads21:08:492
30769997037,7cyclictest181rcu_preempt22:55:272
30761997055,8cyclictest0-21swapper/121:28:351
30761997055,8cyclictest0-21swapper/121:28:351
30761997054,9cyclictest0-21swapper/122:03:111
30761997048,15cyclictest1-21systemd23:22:161
30753997051,7cyclictest181rcu_preempt22:21:450
30753997050,14cyclictest6351-21sh23:53:120
30753997050,10cyclictest0-21swapper/022:38:140
30753997045,17cyclictest0-21swapper/022:53:360
30769996949,14cyclictest21056-21latency21:33:402
30769996948,12cyclictest0-21swapper/222:38:502
30761996954,8cyclictest0-21swapper/122:03:501
30761996954,8cyclictest0-21swapper/122:03:501
30753996953,8cyclictest0-21swapper/020:23:460
30753996943,19cyclictest0-21swapper/021:23:520
30753996941,21cyclictest9442-21kworker/u17:4+nfsiod23:11:510
30753996940,22cyclictest0-21swapper/021:18:580
30769996851,11cyclictest9890-21kworker/u17:4-events_unbound20:53:112
30769996851,11cyclictest9890-21kworker/u17:4-events_unbound20:53:112
30769996847,12cyclictest0-21swapper/200:13:352
30769996846,12cyclictest0-21swapper/223:28:292
30769996846,12cyclictest0-21swapper/223:28:292
30769996843,18cyclictest30740-21cyclictest22:08:352
30769996841,8cyclictest181rcu_preempt19:13:402
30769996841,8cyclictest181rcu_preempt19:13:402
30769996830,20cyclictest27564-21head20:33:482
30761996853,9cyclictest17991-21fschecks_count22:23:361
30761996853,9cyclictest17991-21fschecks_count22:23:361
30761996852,8cyclictest0-21swapper/119:23:341
30761996847,15cyclictest9299-40mandb23:58:141
30753996850,12cyclictest5226-21diskmemload22:18:150
30753996850,12cyclictest5226-21diskmemload22:18:150
30753996846,13cyclictest1492-21ssh21:54:330
30753996846,13cyclictest1492-21ssh21:54:330
30753996832,15cyclictest0-21swapper/023:28:450
30753996832,15cyclictest0-21swapper/023:28:450
30753996828,20cyclictest0-21swapper/022:04:290
30753996828,20cyclictest0-21swapper/022:04:290
30753996825,10cyclictest0-21swapper/019:08:500
2925426810,27sleep30-21swapper/319:03:263
30769996747,11cyclictest0-21swapper/223:43:342
30769996743,15cyclictest21789-21apt20:18:242
30769996740,20cyclictest18751-21netstat23:18:412
30769996740,17cyclictest14482-21sh00:05:132
30769996740,17cyclictest14482-21sh00:05:132
30761996754,7cyclictest0-21swapper/122:57:121
30761996751,10cyclictest8548-21cron19:38:131
30761996749,13cyclictest24154-21threads20:23:501
30761996747,10cyclictest0-21swapper/123:13:351
30761996732,9cyclictest0-21swapper/121:50:381
30753996732,17cyclictest15-21ksoftirqd/019:29:400
30769996646,14cyclictest26464-21apt-key21:43:172
30769996645,11cyclictest0-21swapper/220:43:362
30769996645,11cyclictest0-21swapper/220:43:362
30769996644,16cyclictest17613-21/usr/sbin/munin21:28:332
30769996644,16cyclictest17613-21/usr/sbin/munin21:28:332
30769996640,18cyclictest15586-21fschecks_time19:58:372
30769996637,11cyclictest181rcu_preempt23:41:082
30761996651,8cyclictest0-21swapper/123:28:491
30761996651,8cyclictest0-21swapper/123:28:491
30761996646,14cyclictest30225-21sh23:38:231
30761996634,24cyclictest29070-21timerwakeupswit20:38:481
3832652,5sleep00-21swapper/020:53:130
3832652,5sleep00-21swapper/020:53:130
30769996549,11cyclictest17813-21runrttasks23:18:062
30769996549,10cyclictest32508-21sh00:37:222
30769996545,13cyclictest0-21swapper/222:53:152
30769996544,15cyclictest15381-21sh22:18:412
30769996543,11cyclictest0-21swapper/221:38:402
30761996551,10cyclictest30740-21cyclictest22:18:121
30761996551,10cyclictest30740-21cyclictest22:18:121
30761996550,8cyclictest0-21swapper/122:28:391
30761996550,8cyclictest0-21swapper/122:28:391
30761996534,12cyclictest773-21kworker/u17:3-xprtiod23:43:431
180942650,7sleep20-21swapper/200:12:362
96192640,6sleep30-21swapper/323:04:003
96192640,6sleep30-21swapper/323:04:003
30769996447,10cyclictest0-21swapper/222:23:362
30769996447,10cyclictest0-21swapper/222:23:362
30769996444,10cyclictest0-21swapper/221:53:522
30769996444,10cyclictest0-21swapper/221:53:522
30761996450,10cyclictest30740-21cyclictest00:07:211
30761996450,10cyclictest30740-21cyclictest00:07:211
30761996449,9cyclictest24829-21diskmemload00:23:541
30761996449,9cyclictest0-21swapper/122:13:111
30761996430,10cyclictest0-21swapper/119:29:351
30753996445,13cyclictest3500-21munin-plugin-st19:23:140
30753996445,13cyclictest3500-21munin-plugin-st19:23:140
30753996443,13cyclictest0-21swapper/019:53:480
16902640,7sleep30-21swapper/319:16:083
16902640,7sleep30-21swapper/319:16:083
30769996347,10cyclictest309-21systemd-logind21:08:132
30769996342,14cyclictest0-21swapper/219:38:332
30769996342,14cyclictest0-21swapper/219:38:332
30769996341,11cyclictest0-21swapper/220:03:362
30761996347,10cyclictest15297-21/usr/sbin/munin19:58:431
30774996247,9cyclictest0-21swapper/322:48:263
30769996245,10cyclictest11890-21kworker/u17:3-events_unbound19:58:122
30769996238,12cyclictest0-21swapper/219:53:152
30761996247,9cyclictest31626-21cat19:08:461
30761996245,11cyclictest355-21runrttasks20:48:121
30761996245,11cyclictest355-21runrttasks20:48:121
30761996243,13cyclictest5226-21diskmemload21:18:361
30753996243,11cyclictest0-21swapper/019:38:450
30753996243,11cyclictest0-21swapper/019:38:450
30753996241,10cyclictest0-21swapper/019:28:150
30753996234,20cyclictest1958-21modprobe20:58:110
30769996143,8cyclictest0-21swapper/219:18:452
30769996143,8cyclictest0-21swapper/219:18:452
30761996143,12cyclictest16647-21threads00:08:491
30769996039,10cyclictest0-21swapper/220:38:342
30761996044,10cyclictest16911-21/usr/sbin/munin20:03:421
30761996032,19cyclictest340-21modprobe20:53:111
30761996032,19cyclictest340-21modprobe20:53:111
30753995944,7cyclictest0-21swapper/020:03:300
30769995839,9cyclictest0-21swapper/219:38:152
30761995844,10cyclictest30740-21cyclictest19:18:451
30761995844,10cyclictest30740-21cyclictest19:18:451
30761995843,9cyclictest316-21rs:main1
30761995842,8cyclictest0-21swapper/120:58:111
30761995822,9cyclictest181rcu_preempt20:28:451
30761995741,11cyclictest1-21systemd19:13:231
30761995741,11cyclictest1-21systemd19:13:231
30761995724,23cyclictest18899-21kernelversion20:08:411
30761995724,23cyclictest18899-21kernelversion20:08:411
30753995742,8cyclictest0-21swapper/020:08:410
30753995742,8cyclictest0-21swapper/020:08:410
3077499553,42cyclictest29392-21taskset21:48:143
30761995526,10cyclictest0-21swapper/120:58:311
3077499544,39cyclictest21187-21taskset23:23:293
3077499544,39cyclictest21187-21taskset23:23:293
3077499544,38cyclictest12965-21chrt22:13:513
3077499544,38cyclictest12965-21chrt22:13:513
3077499543,40cyclictest15223-21taskset21:23:423
30761995439,8cyclictest0-21swapper/120:18:501
30761995426,9cyclictest0-21swapper/119:38:271
30761995426,9cyclictest0-21swapper/119:38:271
3077499534,40cyclictest9841-21taskset23:58:263
3077499534,38cyclictest7230-21chrt22:58:493
3077499534,38cyclictest7230-21chrt22:58:493
3077499533,38cyclictest9787-21taskset19:38:483
3077499533,38cyclictest9787-21taskset19:38:483
3077499533,38cyclictest27168-21chrt20:33:433
30761995321,23cyclictest26608-21apt-get20:33:281
3077499524,38cyclictest21006-21taskset22:28:383
3077499524,38cyclictest21006-21taskset22:28:383
3077499524,37cyclictest714-21chrt20:53:323
3077499524,35cyclictest12017-21taskset19:48:153
3077499524,34cyclictest28406-21taskset20:38:333
3077499523,38cyclictest22352-21chrt20:18:453
3077499518,33cyclictest6671-21chrt23:53:283
3077499514,38cyclictest5981-21taskset23:52:143
3077499514,37cyclictest8918-21chrt22:08:193
3077499514,37cyclictest30051-21taskset20:43:353
3077499514,37cyclictest30051-21taskset20:43:353
3077499514,37cyclictest21142-21taskset20:13:553
3077499514,36cyclictest4185-21taskset21:03:363
3077499514,36cyclictest26401-21chrt21:43:153
3077499514,36cyclictest16150-21taskset23:13:483
3077499514,34cyclictest20788-21chrt21:33:353
3077499513,39cyclictest30577-21chrt22:44:343
3077499513,39cyclictest30577-21chrt22:44:343
3077499513,38cyclictest30092-21taskset21:48:383
3077499513,35cyclictest24500-21chrt00:23:163
3077499512,39cyclictest32506-21taskset00:37:223
3077499507,34cyclictest26475-21chrt23:32:283
3077499507,34cyclictest26475-21chrt23:32:283
3077499504,33cyclictest3313-21chrt22:53:263
3077499504,33cyclictest25021-21chrt00:24:053
3077499504,31cyclictest18484-21chrt20:08:163
3077499503,37cyclictest32225-21taskset20:48:503
3077499503,37cyclictest32225-21taskset20:48:503
3077499503,37cyclictest16577-21taskset00:08:483
3077499503,36cyclictest12069-21chrt19:48:233
3077499503,36cyclictest1064-21chrt23:43:353
3077499503,35cyclictest29521-21chrt22:43:163
3077499503,35cyclictest13882-21chrt19:53:343
3077499503,30cyclictest25098-21chrt20:28:293
3077499502,37cyclictest21075-21chrt00:17:483
3077499502,36cyclictest10518-21chrt19:43:293
3077499495,33cyclictest5305-21chrt19:28:143
3077499494,34cyclictest15971-21chrt19:58:483
3077499494,33cyclictest18225-21taskset23:18:263
3077499493,35cyclictest27786-21chrt00:28:353
3077499493,35cyclictest27786-21chrt00:28:353
3077499485,33cyclictest25680-21chrt22:37:043
3077499484,34cyclictest24321-21chrt20:23:513
3077499483,36cyclictest12078-21taskset21:18:353
3077499483,35cyclictest29793-21taskset23:37:553
3077499483,35cyclictest18004-21chrt21:28:363
3077499483,35cyclictest18004-21chrt21:28:363
3077499483,32cyclictest7374-21chrt21:10:533
3077499483,32cyclictest11568-21chrt21:18:153
3077499475,32cyclictest15822-21taskset22:18:493
3077499474,32cyclictest13799-21chrt23:09:553
3077499473,34cyclictest15014-21taskset00:06:503
3077499473,34cyclictest15014-21taskset00:06:503
3077499473,33cyclictest19676-21taskset22:26:193
3077499473,33cyclictest19676-21taskset22:26:193
3077499473,32cyclictest2292-21taskset20:58:303
3077499472,35cyclictest2059-21chrt21:56:123
3077499472,35cyclictest2059-21chrt21:56:123
3077499472,33cyclictest7704-21chrt19:33:413
3077499464,31cyclictest3121-21chrt21:58:273
3077499463,33cyclictest5836-21taskset19:29:283
3077499463,33cyclictest543-21chrt23:43:143
3077499462,33cyclictest8461-21chrt22:07:433
3077499462,33cyclictest8461-21chrt22:07:433
3077499444,29cyclictest31629-21taskset19:08:473
3077499422,26cyclictest2910-21taskset19:18:473
3077499422,26cyclictest2910-21taskset19:18:473
3077499403,27cyclictest19587-21taskset20:09:383
3077499403,27cyclictest19587-21taskset20:09:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional