You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 08:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Jul 28, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24313218050,22sleep224299-21apt-get18:51:312
2538421247,19sleep10-21swapper/118:53:101
258609910625,43cyclictest0-21swapper/222:42:392
258609910625,43cyclictest0-21swapper/222:42:392
258609910532,36cyclictest0-21swapper/223:06:082
258609910532,36cyclictest0-21swapper/223:06:082
54321040,6sleep20-21swapper/220:56:102
258389910480,18cyclictest298-21in:imuxsock23:44:100
258389910480,18cyclictest298-21in:imuxsock23:44:100
258609910050,40cyclictest0-21swapper/221:26:422
25380210015,57sleep024279-21/usr/sbin/munin18:53:090
25860999840,47cyclictest13519-21/usr/sbin/munin19:56:302
55692970,28sleep1291rcuc/122:51:411
25860999768,20cyclictest19260-21sh00:09:102
25860999768,20cyclictest19260-21sh00:09:102
2586099973,77cyclictest0-21swapper/223:31:192
25860999650,39cyclictest28914-21sh00:26:062
2586099963,76cyclictest0-21swapper/219:51:232
25860999524,31cyclictest0-21swapper/222:08:262
25845999469,19cyclictest27123-21sh00:21:431
25838999436,30cyclictest181rcu_preempt22:21:290
2586099924,77cyclictest0-21swapper/221:21:232
25860999247,37cyclictest21398-21cron21:31:112
25860999247,37cyclictest21398-21cron21:31:112
2586099923,57cyclictest0-21swapper/223:37:312
2586099893,74cyclictest0-21swapper/219:21:242
25845998868,14cyclictest25493-21ssh00:19:541
25845998868,14cyclictest25493-21ssh00:19:541
2586099874,76cyclictest0-21swapper/221:06:232
2586099872,72cyclictest0-21swapper/219:11:232
2586099872,72cyclictest0-21swapper/219:11:232
2586099872,61cyclictest26736-21runrttasks20:36:492
25845998753,16cyclictest181rcu_preempt23:17:081
25838998760,7cyclictest181rcu_preempt23:53:440
2583899874,37cyclictest15-21ksoftirqd/019:16:190
25860998638,40cyclictest0-21swapper/223:11:352
25860998638,40cyclictest0-21swapper/223:11:352
25838998661,18cyclictest1-21systemd22:18:240
25838998661,18cyclictest1-21systemd22:18:240
25860998558,19cyclictest12709-21sh21:16:162
25860998547,30cyclictest0-21swapper/222:16:332
25860998547,30cyclictest0-21swapper/222:16:332
2586099853,75cyclictest22263-21ssh22:26:232
2586099853,75cyclictest22263-21ssh22:26:232
25845998561,18cyclictest436-21diskmemload21:22:261
25845998536,27cyclictest25819-21cyclictest22:47:531
25838998562,15cyclictest2374-21systemd-journal21:39:240
25838998547,7cyclictest181rcu_preempt22:58:500
25845998464,13cyclictest3425-21kworker/u17:3-rpciod23:56:111
25845998419,38cyclictest4607-21switchtime19:26:431
25838998463,8cyclictest181rcu_preempt20:59:180
25838998457,17cyclictest2374-21systemd-journal21:51:070
25838998456,19cyclictest23588-21kernelversion20:26:330
25838998442,12cyclictest181rcu_preempt19:31:350
2586099833,68cyclictest0-21swapper/220:21:212
25845998363,12cyclictest0-21swapper/121:51:441
25845998363,12cyclictest0-21swapper/121:51:441
25845998362,10cyclictest0-21swapper/120:37:271
25845998360,12cyclictest0-21swapper/119:51:101
25845998354,8cyclictest181rcu_preempt22:36:441
25838998367,10cyclictest16609-21timerandwakeup21:21:430
2583899836,50cyclictest15-21ksoftirqd/023:26:220
25838998361,17cyclictest25819-21cyclictest22:06:080
25838998361,17cyclictest25819-21cyclictest22:06:080
25838998361,15cyclictest25819-21cyclictest21:06:440
25838998358,10cyclictest181rcu_preempt21:56:420
25838998350,12cyclictest181rcu_preempt00:19:370
25838998350,12cyclictest181rcu_preempt00:19:370
25838998350,10cyclictest181rcu_preempt22:36:450
25838998345,11cyclictest58-21kcompactd022:06:140
2586099829,51cyclictest0-21swapper/223:47:392
2586099824,67cyclictest0-21swapper/220:16:222
25860998242,34cyclictest436-21diskmemload00:16:252
25860998242,34cyclictest436-21diskmemload00:16:252
25860998233,42cyclictest0-21swapper/222:46:422
25845998261,11cyclictest0-21swapper/122:01:111
25838998234,11cyclictest181rcu_preempt23:11:320
25838998234,11cyclictest181rcu_preempt23:11:320
2586099814,57cyclictest0-21swapper/200:14:402
25860998141,33cyclictest0-21swapper/222:26:062
25860998137,36cyclictest0-21swapper/222:36:442
2586099813,70cyclictest0-21swapper/221:01:242
25845998160,14cyclictest26284-21sh23:26:391
25845998160,12cyclictest0-21swapper/100:08:401
25845998160,12cyclictest0-21swapper/100:08:401
25845998160,11cyclictest0-21swapper/123:41:091
25838998137,24cyclictest181rcu_preempt23:16:340
25860998043,30cyclictest0-21swapper/223:56:092
25860998039,32cyclictest0-21swapper/218:57:222
2586099803,71cyclictest0-21swapper/221:51:222
2586099803,71cyclictest0-21swapper/221:51:222
2586099803,63cyclictest0-21swapper/219:06:182
2586099803,63cyclictest0-21swapper/219:06:182
25860998035,38cyclictest0-21swapper/223:21:282
25860998035,38cyclictest0-21swapper/223:21:282
25860998032,40cyclictest0-21swapper/223:56:422
25860998013,56cyclictest23220-21cat20:26:172
25845998066,7cyclictest0-21swapper/120:21:431
25845998062,9cyclictest0-21swapper/121:36:331
25845998060,11cyclictest0-21swapper/119:36:101
25845998057,12cyclictest0-21swapper/120:06:251
25845998057,12cyclictest0-21swapper/119:26:101
25845998044,15cyclictest181rcu_preempt22:31:411
25845998037,18cyclictest58-21kcompactd019:54:131
25860997954,18cyclictest14542-21sh23:06:412
25860997937,32cyclictest0-21swapper/223:18:352
2586099793,71cyclictest0-21swapper/222:31:232
25860997933,37cyclictest0-21swapper/220:01:332
25860997933,37cyclictest0-21swapper/220:01:332
2586099792,59cyclictest5468-21apt-get19:31:192
25860997921,8cyclictest0-21swapper/222:56:452
25845997960,12cyclictest0-21swapper/119:41:261
25845997960,12cyclictest0-21swapper/119:41:261
25845997960,10cyclictest0-21swapper/123:31:321
25845997955,13cyclictest0-21swapper/122:46:091
25845997955,13cyclictest0-21swapper/122:46:091
25845997948,22cyclictest25290-21cron23:26:061
25845997948,22cyclictest25290-21cron23:26:061
25845997937,17cyclictest25819-21cyclictest23:42:541
25845997937,17cyclictest25819-21cyclictest23:42:541
25838997956,17cyclictest436-21diskmemload00:26:090
25838997932,8cyclictest181rcu_preempt19:41:110
2586099783,69cyclictest0-21swapper/220:06:192
25860997830,38cyclictest0-21swapper/223:26:172
25860997825,32cyclictest0-21swapper/222:00:522
25845997860,9cyclictest0-21swapper/120:01:321
25845997860,9cyclictest0-21swapper/120:01:321
25845997853,15cyclictest0-21swapper/120:16:301
25845997842,10cyclictest181rcu_preempt23:07:321
25838997854,10cyclictest181rcu_preempt21:31:220
25838997854,10cyclictest181rcu_preempt21:31:220
25838997852,7cyclictest181rcu_preempt20:31:400
25838997832,12cyclictest181rcu_preempt22:43:360
25838997832,12cyclictest181rcu_preempt22:43:360
25838997824,9cyclictest181rcu_preempt21:51:240
25838997824,9cyclictest181rcu_preempt21:51:240
25860997733,37cyclictest0-21swapper/221:16:092
25845997750,11cyclictest181rcu_preempt19:17:551
25845997747,7cyclictest11374-21ssh23:56:221
25838997754,14cyclictest3580-21ssh22:48:240
25838997739,8cyclictest181rcu_preempt22:26:330
25838997739,8cyclictest181rcu_preempt22:26:330
25838997733,8cyclictest181rcu_preempt23:47:110
25838997733,35cyclictest0-21swapper/021:31:090
25838997724,39cyclictest16432-21ssh23:11:060
2586099765,62cyclictest30722-21ssh21:46:182
2586099764,64cyclictest0-21swapper/220:31:222
25860997630,38cyclictest7862-21timerandwakeup19:36:432
2586099762,62cyclictest0-21swapper/220:11:232
25845997662,10cyclictest25819-21cyclictest20:11:251
25845997657,12cyclictest0-21swapper/120:31:311
25845997622,12cyclictest181rcu_preempt22:26:071
25838997661,8cyclictest0-21swapper/023:31:430
25838997646,7cyclictest181rcu_preempt21:21:010
25838997639,10cyclictest58-21kcompactd000:01:380
25838997638,13cyclictest10763-21/usr/sbin/munin23:01:330
25838997638,13cyclictest10763-21/usr/sbin/munin23:01:330
2586099753,62cyclictest0-21swapper/200:01:182
2586099752,61cyclictest2202-21apt-get23:41:202
2586099752,61cyclictest2202-21apt-get23:41:202
25860997521,47cyclictest7232-21basename22:01:192
25860997521,47cyclictest7232-21basename22:01:192
25845997558,10cyclictest0-21swapper/122:56:351
25845997556,12cyclictest25819-21cyclictest19:36:441
25845997554,10cyclictest0-21swapper/119:01:111
25845997547,19cyclictest13554-21cut22:11:311
25845997542,12cyclictest181rcu_preempt21:04:121
25845997527,10cyclictest181rcu_preempt22:06:291
25838997533,8cyclictest181rcu_preempt20:21:100
2586099744,62cyclictest10313-21apt-get19:46:202
2586099742,66cyclictest0-21swapper/221:41:252
2586099742,61cyclictest28025-21runrttasks19:01:162
2586099742,61cyclictest28025-21runrttasks19:01:162
2586099742,60cyclictest13245-21apt-get22:11:192
25845997455,7cyclictest31-21ksoftirqd/121:33:521
25845997455,7cyclictest31-21ksoftirqd/121:33:521
25845997448,10cyclictest181rcu_preempt22:20:481
25845997448,10cyclictest181rcu_preempt22:20:481
25845997446,8cyclictest181rcu_preempt00:14:591
25845997446,19cyclictest23054-21sh22:26:431
25845997446,19cyclictest23054-21sh22:26:431
25838997455,9cyclictest0-21swapper/021:01:470
25838997450,16cyclictest11427-21sh23:56:340
25838997446,7cyclictest181rcu_preempt22:55:380
25838997445,7cyclictest181rcu_preempt00:09:020
25838997445,7cyclictest181rcu_preempt00:09:020
25838997432,8cyclictest181rcu_preempt21:41:430
25838997430,9cyclictest181rcu_preempt22:11:160
25838997428,9cyclictest181rcu_preempt19:16:090
25838997428,9cyclictest181rcu_preempt19:16:090
2586099734,49cyclictest1789-21grep20:56:452
25860997340,10cyclictest181rcu_preempt20:46:072
25860997340,10cyclictest181rcu_preempt20:46:072
25860997320,40cyclictest30277-21awk20:46:332
25845997351,11cyclictest0-21swapper/119:11:301
25845997351,11cyclictest0-21swapper/119:11:301
2584599734,28cyclictest301ktimers/119:56:211
25845997338,8cyclictest181rcu_preempt21:09:501
25845997326,13cyclictest181rcu_preempt21:12:291
25838997356,11cyclictest11990-21cpuspeed19:51:240
25838997355,9cyclictest0-21swapper/022:36:090
2583899733,57cyclictest18641-21fschecks_time20:11:310
25845997251,10cyclictest0-21swapper/119:06:101
25845997251,10cyclictest0-21swapper/119:06:101
25838997257,10cyclictest4489-21mailstats19:26:420
25838997256,9cyclictest0-21swapper/023:37:320
25838997234,9cyclictest58-21kcompactd020:54:490
25838997230,9cyclictest181rcu_preempt00:11:300
275642710,6sleep30-21swapper/320:37:403
2586099719,55cyclictest0-21swapper/222:55:032
2586099712,57cyclictest10023-21modprobe19:46:072
2586099712,57cyclictest10023-21modprobe19:46:072
25845997152,14cyclictest25819-21cyclictest22:01:251
25845997152,14cyclictest25819-21cyclictest22:01:251
25845997149,13cyclictest0-21swapper/120:31:091
25845997144,19cyclictest544-21cron23:06:071
25845997144,19cyclictest544-21cron23:06:071
25845997144,19cyclictest436-21diskmemload00:02:441
25845997133,13cyclictest436-21diskmemload21:47:521
25838997132,8cyclictest181rcu_preempt19:01:200
25838997132,8cyclictest181rcu_preempt19:01:200
2586099703,53cyclictest1969-21modprobe19:21:072
25860997029,35cyclictest26936-21sh21:39:522
25838997045,18cyclictest0-21swapper/023:21:430
25838997045,18cyclictest0-21swapper/023:21:430
25838997043,8cyclictest181rcu_preempt20:46:200
25838997036,8cyclictest181rcu_preempt19:26:110
25838997030,11cyclictest181rcu_preempt20:21:110
25838997029,9cyclictest181rcu_preempt19:46:200
25838997028,8cyclictest181rcu_preempt20:37:320
25838997028,11cyclictest181rcu_preempt20:06:080
25838997028,11cyclictest181rcu_preempt20:06:080
25845996951,12cyclictest352-21runrttasks21:26:301
25845996949,13cyclictest25819-21cyclictest21:42:301
25845996948,8cyclictest181rcu_preempt20:58:011
25845996935,22cyclictest30066-21cut19:06:281
25845996935,22cyclictest30066-21cut19:06:281
25845996915,10cyclictest181rcu_preempt23:48:291
25838996934,7cyclictest181rcu_preempt20:06:240
25838996929,8cyclictest181rcu_preempt20:41:370
25838996929,8cyclictest181rcu_preempt20:41:370
2583899692,57cyclictest26192-21apt-get18:56:320
2586099683,57cyclictest4589-21cat19:26:432
25845996845,15cyclictest29641-21latency_hist20:46:091
25845996845,15cyclictest29641-21latency_hist20:46:091
25845996823,12cyclictest181rcu_preempt23:11:311
25845996823,12cyclictest181rcu_preempt23:11:311
2583899685,44cyclictest12662-21latency_hist21:16:110
25845996748,9cyclictest0-21swapper/120:51:411
25845996745,8cyclictest181rcu_preempt21:17:371
2584599673,42cyclictest30119-21fschecks_count20:46:301
2583899674,42cyclictest30040-21grep19:06:280
2583899674,42cyclictest30040-21grep19:06:280
2583899653,44cyclictest10021-21latency_hist19:46:100
2583899653,44cyclictest10021-21latency_hist19:46:100
25838996529,8cyclictest181rcu_preempt19:56:440
2588299633,41cyclictest1277-21chrt22:45:223
2588299633,41cyclictest1277-21chrt22:45:223
117792620,6sleep30-21swapper/321:14:193
2588299593,40cyclictest21349-21taskset20:21:073
2588299593,39cyclictest26072-21taskset18:56:133
2588299582,41cyclictest16269-21chrt22:16:243
2588299582,41cyclictest16269-21chrt22:16:243
2588299564,42cyclictest29577-21chrt21:43:533
2588299564,41cyclictest25671-21taskset23:26:213
2588299564,36cyclictest28684-21chrt23:31:243
2588299564,33cyclictest2145-21chrt23:41:133
2588299564,33cyclictest2145-21chrt23:41:133
2588299563,38cyclictest16500-21taskset23:11:093
2588299563,37cyclictest23183-21chrt23:21:353
2588299563,37cyclictest23183-21chrt23:21:353
2588299553,38cyclictest8969-21taskset19:41:343
2588299553,38cyclictest8969-21taskset19:41:343
2588299553,38cyclictest22457-21chrt20:21:443
2588299544,35cyclictest5299-21chrt23:46:243
2588299544,34cyclictest31831-21taskset23:36:183
2588299543,34cyclictest6742-21taskset21:06:163
2588299542,40cyclictest16131-21chrt21:21:323
2588299542,37cyclictest22192-21taskset23:20:423
2588299542,36cyclictest23097-21chrt00:16:093
2588299533,39cyclictest8026-21taskset19:36:443
2588299533,37cyclictest8554-21chrt22:02:223
2588299533,37cyclictest8554-21chrt22:02:223
2588299533,35cyclictest24411-21chrt21:36:073
2588299533,35cyclictest24411-21chrt21:36:073
2588299533,33cyclictest1928-21chrt22:46:243
2588299532,37cyclictest4587-21taskset19:26:433
2588299523,37cyclictest14096-21taskset21:17:273
2588299523,35cyclictest32133-21taskset20:51:413
2588299523,34cyclictest11459-21chrt23:01:403
2588299523,34cyclictest11459-21chrt23:01:403
2588299522,38cyclictest10319-21taskset22:06:233
2588299514,36cyclictest5901-21chrt19:31:333
2588299514,32cyclictest19961-21chrt00:11:063
2588299514,32cyclictest19961-21chrt00:11:063
2588299513,37cyclictest23764-21chrt00:16:343
2588299513,37cyclictest23764-21chrt00:16:343
2588299513,37cyclictest17313-21chrt23:11:383
2588299513,37cyclictest17313-21chrt23:11:383
2588299513,36cyclictest30888-21chrt21:46:253
2588299513,36cyclictest23910-21chrt22:28:233
2588299513,36cyclictest23910-21chrt22:28:233
2588299513,35cyclictest5869-21chrt21:04:343
2588299513,34cyclictest20052-21chrt22:21:433
2588299512,40cyclictest15554-21chrt00:02:103
2588299505,33cyclictest11368-21chrt23:56:273
2588299504,32cyclictest25656-21chrt20:31:443
2588299503,33cyclictest4252-21chrt21:56:183
2588299503,33cyclictest21457-21chrt21:31:093
2588299503,32cyclictest28644-21chrt20:41:333
2588299503,32cyclictest28644-21chrt20:41:333
2588299503,30cyclictest4859-21chrt22:51:183
2588299494,34cyclictest9050-21chrt22:57:063
2588299493,37cyclictest3328-21chrt21:54:273
2588299493,37cyclictest3328-21chrt21:54:273
2588299493,36cyclictest28655-21chrt00:25:223
2588299492,36cyclictest13692-21chrt19:56:283
2588299483,35cyclictest26180-21chrt22:31:443
2588299483,34cyclictest14280-21chrt22:11:463
2588299483,32cyclictest3004-21chrt20:59:563
2588299483,30cyclictest30151-21chrt20:46:313
2588299478,30cyclictest30936-21taskset22:41:083
2588299473,29cyclictest509-21chrt19:16:103
2588299473,29cyclictest509-21chrt19:16:103
2588299472,30cyclictest25923-21chrt21:37:013
2588299464,31cyclictest1994-21taskset19:21:083
2588299454,32cyclictest12079-21chrt19:51:263
2588299444,30cyclictest27529-21taskset19:01:073
2588299444,26cyclictest28202-21chrt19:01:193
2588299444,26cyclictest28202-21chrt19:01:193
2588299442,28cyclictest8124-21chrt23:51:193
2588299424,27cyclictest30930-21taskset19:07:443
2588299424,27cyclictest30930-21taskset19:07:443
2588299423,28cyclictest23240-21taskset20:26:223
2588299413,29cyclictest18672-21taskset20:11:313
2588299413,27cyclictest17795-21taskset20:07:023
2588299412,27cyclictest2200-21taskset19:21:123
2588299403,27cyclictest10316-21taskset19:46:203
2588299402,28cyclictest15292-21chrt20:01:273
2588299402,28cyclictest15292-21chrt20:01:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional