You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-06 - 10:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Jun 06, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28850213516,32sleep30-21swapper/318:59:403
290289910263,18cyclictest181rcu_preempt23:05:152
290289910263,18cyclictest181rcu_preempt23:05:152
29023999857,15cyclictest181rcu_preempt23:14:401
29023999854,12cyclictest181rcu_preempt19:06:241
29023999854,12cyclictest181rcu_preempt19:06:241
29023999854,11cyclictest181rcu_preempt23:29:441
29023999854,11cyclictest181rcu_preempt23:29:441
288142986,16sleep20-21swapper/218:59:102
29023999748,14cyclictest10814-21kworker/u19:3-flush-0:3222:22:451
29019999636,32cyclictest0-21swapper/021:35:140
29028999369,8cyclictest181rcu_preempt19:10:122
29028999369,8cyclictest181rcu_preempt19:10:122
29028999360,10cyclictest181rcu_preempt22:26:342
29028999360,10cyclictest181rcu_preempt22:26:342
29028999348,10cyclictest181rcu_preempt00:20:052
29028999348,10cyclictest181rcu_preempt00:20:052
2759429324,36sleep00-21swapper/018:55:000
29023999262,9cyclictest181rcu_preempt22:25:241
29023999262,9cyclictest181rcu_preempt22:25:241
29023999244,12cyclictest181rcu_preempt21:03:241
29023999235,19cyclictest0-21swapper/100:29:421
29019999270,12cyclictest20957-21sshd23:15:230
29019999270,12cyclictest20957-21sshd23:15:230
29028999148,16cyclictest181rcu_preempt19:55:152
29028999148,16cyclictest181rcu_preempt19:55:152
29023999161,11cyclictest181rcu_preempt23:44:581
29023999161,11cyclictest181rcu_preempt23:44:581
2902899904,50cyclictest39-21ksoftirqd/223:50:182
29023999050,8cyclictest181rcu_preempt21:35:591
29023998954,13cyclictest181rcu_preempt23:00:131
29028998858,8cyclictest181rcu_preempt23:18:012
29028998858,8cyclictest181rcu_preempt23:18:012
29028998849,8cyclictest181rcu_preempt22:58:522
29028998847,10cyclictest181rcu_preempt22:33:482
29028998842,13cyclictest181rcu_preempt23:40:232
29028998842,13cyclictest181rcu_preempt23:40:232
29028998829,26cyclictest0-21swapper/220:45:162
29023998875,9cyclictest29011-21cyclictest21:45:151
29023998875,9cyclictest29011-21cyclictest21:45:151
29023998852,14cyclictest181rcu_preempt22:40:051
29023998845,8cyclictest181rcu_preempt21:22:591
29023998838,18cyclictest0-21swapper/100:17:501
29028998768,12cyclictest9656-21kworker/u17:2-rpciod22:16:402
29028998756,12cyclictest181rcu_preempt21:59:462
29028998734,18cyclictest0-21swapper/221:12:022
29028998734,18cyclictest0-21swapper/221:12:022
29028998732,35cyclictest0-21swapper/223:47:532
29028998732,35cyclictest0-21swapper/223:47:532
29028998731,17cyclictest0-21swapper/220:00:062
29028998731,17cyclictest0-21swapper/220:00:062
29023998752,9cyclictest181rcu_preempt23:15:291
29023998752,9cyclictest181rcu_preempt23:15:291
29028998650,13cyclictest181rcu_preempt20:14:422
2902899863,62cyclictest31462-21apt-get19:05:022
2902899863,62cyclictest31462-21apt-get19:05:022
29028998630,24cyclictest0-21swapper/222:07:302
29023998665,15cyclictest23672-21latency_hist20:19:431
29023998663,8cyclictest181rcu_preempt00:10:051
29023998634,11cyclictest0-21swapper/120:01:011
29023998634,11cyclictest0-21swapper/120:01:011
2902899859,58cyclictest4101-21apt-get19:19:532
29028998562,15cyclictest3821-21kworker/u17:0-rpciod21:15:032
29028998553,11cyclictest181rcu_preempt21:03:362
29028998547,12cyclictest181rcu_preempt00:16:272
29028998536,21cyclictest11957-21fschecks_count23:00:012
29023998560,17cyclictest20337-21apt-key20:09:441
29023998560,17cyclictest20337-21apt-key20:09:441
29023998546,9cyclictest181rcu_preempt22:14:181
29023998544,8cyclictest181rcu_preempt21:42:161
29023998543,32cyclictest25578-21kworker/u18:1+nfsiod23:44:431
29023998543,32cyclictest25578-21kworker/u18:1+nfsiod23:44:431
29023998532,12cyclictest0-21swapper/123:38:441
29019998566,13cyclictest3600-21idleruntime-cro19:19:400
29028998459,7cyclictest181rcu_preempt22:46:282
2902899843,51cyclictest39-21ksoftirqd/223:14:372
29028998430,18cyclictest0-21swapper/222:35:512
29028998430,18cyclictest0-21swapper/222:35:512
29028998426,26cyclictest0-21swapper/200:05:182
29023998461,9cyclictest181rcu_preempt20:40:081
29023998461,9cyclictest181rcu_preempt20:40:081
29023998434,30cyclictest2449-21/usr/sbin/munin21:50:051
29019998439,34cyclictest0-21swapper/020:20:040
29028998353,12cyclictest181rcu_preempt23:36:052
29028998344,10cyclictest181rcu_preempt21:05:332
29028998344,10cyclictest181rcu_preempt21:05:332
29028998344,10cyclictest181rcu_preempt21:05:332
29023998357,17cyclictest12479-21fschecks_time19:45:021
29023998357,10cyclictest181rcu_preempt19:25:121
29023998341,8cyclictest181rcu_preempt22:50:161
29019998357,18cyclictest7817-21sh21:05:080
29019998357,18cyclictest7817-21sh21:05:080
29019998357,18cyclictest7817-21sh21:05:080
29028998251,8cyclictest181rcu_preempt21:54:432
29028998246,13cyclictest181rcu_preempt22:22:082
29028998245,10cyclictest181rcu_preempt20:15:312
29028998227,20cyclictest0-21swapper/222:50:022
29023998263,13cyclictest5509-21latency_hist19:24:421
29023998259,13cyclictest0-21swapper/123:29:421
29023998250,8cyclictest181rcu_preempt19:15:061
29023998244,8cyclictest181rcu_preempt21:32:081
29023998238,11cyclictest181rcu_preempt22:59:371
29023998236,21cyclictest17114-21sshd23:09:091
29023998236,21cyclictest17114-21sshd23:09:091
29028998133,30cyclictest0-21swapper/221:26:542
29028998124,27cyclictest0-21swapper/221:59:142
29028998124,27cyclictest0-21swapper/221:59:142
29023998157,9cyclictest181rcu_preempt19:40:151
29023998155,12cyclictest181rcu_preempt19:09:571
29023998155,12cyclictest181rcu_preempt19:09:571
29023998141,7cyclictest181rcu_preempt20:10:251
29023998133,10cyclictest0-21swapper/123:55:131
29023998133,10cyclictest0-21swapper/123:55:131
29028998058,11cyclictest0-21swapper/219:15:062
29028998051,10cyclictest181rcu_preempt19:29:432
29028998046,12cyclictest181rcu_preempt23:55:052
29028998046,12cyclictest181rcu_preempt23:55:052
29028998045,14cyclictest181rcu_preempt20:55:132
29028998045,14cyclictest181rcu_preempt20:55:132
29028998042,10cyclictest181rcu_preempt00:29:322
29028998041,7cyclictest181rcu_preempt23:31:072
29028998041,7cyclictest181rcu_preempt23:31:072
29028998032,20cyclictest0-21swapper/221:40:162
29028998024,29cyclictest0-21swapper/220:24:592
29028998021,24cyclictest0-21swapper/200:09:552
29023998059,12cyclictest0-21swapper/123:19:561
29023998051,10cyclictest181rcu_preempt00:09:431
29023998049,8cyclictest181rcu_preempt20:44:571
29023998049,8cyclictest181rcu_preempt20:25:041
29023998047,10cyclictest181rcu_preempt19:35:101
29023998037,12cyclictest181rcu_preempt19:31:551
29023998036,8cyclictest0-21swapper/122:16:411
29028997961,9cyclictest0-21swapper/221:29:562
29028997958,8cyclictest181rcu_preempt21:36:152
29028997950,9cyclictest181rcu_preempt20:20:082
29028997945,13cyclictest181rcu_preempt23:24:102
29028997941,18cyclictest181rcu_preempt21:44:562
29028997941,18cyclictest181rcu_preempt21:44:562
29028997940,10cyclictest181rcu_preempt22:14:382
29023997964,8cyclictest0-21swapper/121:59:501
29023997956,14cyclictest0-21swapper/120:35:161
29023997955,9cyclictest181rcu_preempt20:34:421
29023997952,8cyclictest181rcu_preempt00:04:111
29023997948,9cyclictest181rcu_preempt21:56:331
29023997948,9cyclictest181rcu_preempt21:56:331
29023997948,10cyclictest181rcu_preempt20:55:141
29023997948,10cyclictest181rcu_preempt20:55:141
29023997947,10cyclictest181rcu_preempt21:26:321
29023997943,8cyclictest181rcu_preempt19:54:421
29023997943,8cyclictest181rcu_preempt19:54:421
29023997941,12cyclictest181rcu_preempt19:55:081
29023997941,12cyclictest181rcu_preempt19:55:081
29023997940,12cyclictest181rcu_preempt23:50:371
29023997929,10cyclictest181rcu_preempt21:05:001
29023997929,10cyclictest181rcu_preempt21:05:001
29023997929,10cyclictest181rcu_preempt21:05:001
29019997959,14cyclictest20400-21sh22:20:020
29019997957,14cyclictest4017-21sh21:52:500
29019997947,23cyclictest29363-21grep19:00:010
29028997852,7cyclictest181rcu_preempt21:20:032
29028997849,13cyclictest16695-21rm00:00:242
29028997844,13cyclictest181rcu_preempt19:30:152
29028997844,11cyclictest181rcu_preempt19:44:442
29028997843,8cyclictest181rcu_preempt20:40:172
29028997843,8cyclictest181rcu_preempt20:40:172
29028997843,17cyclictest12441-21fschecks_time19:45:022
29028997842,10cyclictest181rcu_preempt19:00:142
29028997834,16cyclictest0-21swapper/222:41:382
29023997856,16cyclictest5433-21idleruntime-cro22:49:391
29023997841,10cyclictest181rcu_preempt22:30:061
29023997839,13cyclictest181rcu_preempt20:22:401
29019997858,15cyclictest21993-21latency_hist20:14:420
29019997858,14cyclictest32684-21apt-key23:34:440
29019997858,14cyclictest32684-21apt-key23:34:440
29028997743,7cyclictest181rcu_preempt20:34:442
29028997740,11cyclictest181rcu_preempt23:28:202
29028997730,24cyclictest0-21swapper/220:50:022
29023997747,9cyclictest181rcu_preempt20:50:041
29023997746,9cyclictest181rcu_preempt21:10:111
29023997746,9cyclictest181rcu_preempt21:10:111
29023997743,12cyclictest181rcu_preempt22:35:111
29023997743,12cyclictest181rcu_preempt22:35:111
29019997759,13cyclictest16597-21sh22:14:310
29028997646,13cyclictest181rcu_preempt19:35:122
29019997654,15cyclictest26060-21latency_hist22:29:430
29019997654,15cyclictest26060-21latency_hist22:29:430
29019997649,20cyclictest20783-21kworker/u17:3+nfsiod21:45:490
29019997649,20cyclictest20783-21kworker/u17:3+nfsiod21:45:490
2901999763,47cyclictest0-21swapper/019:40:090
29019997561,9cyclictest29011-21cyclictest00:16:200
29019997560,9cyclictest3990-21diskmemload21:33:380
29019997559,10cyclictest6315-21cron23:44:390
29019997559,10cyclictest6315-21cron23:44:390
29019997559,10cyclictest3990-21diskmemload23:05:140
29019997559,10cyclictest3990-21diskmemload23:05:140
29028997452,12cyclictest0-21swapper/220:05:012
29028997452,12cyclictest0-21swapper/220:05:012
29028997427,19cyclictest0-21swapper/219:50:132
29028997427,19cyclictest0-21swapper/219:50:132
29023997427,20cyclictest0-21swapper/100:20:101
29023997427,20cyclictest0-21swapper/100:20:101
29023997427,11cyclictest0-21swapper/122:05:131
29019997459,9cyclictest25520-21kworker/u18:1-rpciod22:16:350
29019997456,12cyclictest2374-21systemd-journal21:01:250
29019997419,36cyclictest32648-21sh00:28:370
29023997328,9cyclictest0-21swapper/118:59:591
29019997358,9cyclictest5799-21rm21:55:150
29019997358,9cyclictest5799-21rm21:55:150
29019997344,23cyclictest0-21swapper/022:40:170
29028997223,8cyclictest0-21swapper/220:34:562
29023997244,8cyclictest181rcu_preempt21:15:081
2901999724,36cyclictest982-21if_eth019:10:030
2901999724,36cyclictest982-21if_eth019:10:030
2901999724,20cyclictest10878-21seq21:10:170
2901999724,20cyclictest10878-21seq21:10:170
29019997220,7cyclictest0-21swapper/021:20:090
29019997218,12cyclictest13233-21/usr/sbin/munin23:55:110
29019997218,12cyclictest13233-21/usr/sbin/munin23:55:110
29019997152,13cyclictest19151-21netstat20:05:070
29019997152,13cyclictest19151-21netstat20:05:070
29019997150,15cyclictest17875-21fschecks_count23:10:020
29019997147,18cyclictest3007-21kworker/u17:1+nfsiod22:57:470
29019997142,20cyclictest6246-21ls22:50:040
2901999712,36cyclictest26999-21/usr/sbin/munin20:30:150
29019997120,19cyclictest30919-21munin-node19:04:520
29019997120,19cyclictest30919-21munin-node19:04:520
29019997117,16cyclictest3165-21http23:39:400
2901999709,31cyclictest29472-21kworker/u17:4+rpciod23:49:320
2901999709,31cyclictest29472-21kworker/u17:4+rpciod23:49:320
29019997052,11cyclictest27614-21ssh00:19:590
29019997052,11cyclictest27614-21ssh00:19:590
2901999702,49cyclictest13183-21rm23:01:220
29019997024,33cyclictest29180-21ssh22:34:540
29019997024,33cyclictest29180-21ssh22:34:540
29019997022,11cyclictest2921-21ssh22:44:540
29019996951,12cyclictest31703-21latency_hist20:44:420
29019996951,12cyclictest31703-21latency_hist20:44:420
29019996947,14cyclictest31281-21latency_hist21:44:420
29019996940,22cyclictest0-21swapper/023:24:430
29019996919,13cyclictest0-21swapper/022:29:510
2901999688,22cyclictest5476-21unin-run19:24:410
29019996844,15cyclictest298-21in:imuxsock20:24:590
29019996840,21cyclictest26767-21kworker/u17:3+nfsiod23:26:120
29019996814,13cyclictest0-21swapper/000:04:510
2901999678,27cyclictest2621-21/usr/sbin/munin20:55:120
2901999678,27cyclictest2621-21/usr/sbin/munin20:55:120
2901999678,24cyclictest31827-21/usr/sbin/munin20:45:200
29019996754,9cyclictest29011-21cyclictest22:00:490
29019996750,10cyclictest14272-21ssh21:15:140
2901999673,38cyclictest22160-21idleruntime-cro21:29:400
29023996614,25cyclictest31-21ksoftirqd/118:59:441
29019996651,9cyclictest18049-21kworker/u17:2+xprtiod00:09:550
29019996649,11cyclictest10778-21ssh23:50:260
29019996645,14cyclictest297-21systemd-logind22:09:410
2901999664,24cyclictest16790-21ssh00:00:410
29019996552,9cyclictest29011-21cyclictest19:27:080
29019996516,14cyclictest15080-21runrttasks19:53:130
29019996516,14cyclictest15080-21runrttasks19:53:130
29019996514,17cyclictest13135-21unixbench_multi19:45:150
29019996513,19cyclictest15-21ksoftirqd/020:37:230
2901999645,24cyclictest17058-21/usr/sbin/munin20:00:120
2901999645,24cyclictest17058-21/usr/sbin/munin20:00:120
2901999644,29cyclictest7929-21ps19:30:110
29019996413,13cyclictest22921-21sed20:15:140
2901999639,19cyclictest9749-21switchtime19:35:140
29019996322,12cyclictest0-21swapper/019:59:340
29019996322,12cyclictest0-21swapper/019:59:340
2901999622,33cyclictest1940-21grep20:50:150
29032996046,9cyclictest451rcuc/319:39:323
2903299604,45cyclictest29392-21taskset21:40:163
2903299535,38cyclictest17788-21taskset00:03:333
2903299533,38cyclictest23179-21chrt22:24:513
2903299533,38cyclictest23179-21chrt22:24:513
2903299533,37cyclictest20764-21chrt23:14:443
2903299524,38cyclictest9548-21chrt22:55:143
2903299524,38cyclictest765-21taskset23:35:363
2903299524,38cyclictest14558-21chrt22:10:083
2903299523,40cyclictest15709-21chrt19:55:023
2903299523,40cyclictest15709-21chrt19:55:023
2903299523,38cyclictest18653-21chrt22:16:493
2903299514,37cyclictest2647-21taskset19:15:063
2903299514,32cyclictest31016-21taskset19:04:453
2903299514,32cyclictest31016-21taskset19:04:453
29032995138,9cyclictest451rcuc/323:02:003
29032995138,9cyclictest451rcuc/320:05:193
29032995138,9cyclictest451rcuc/320:05:193
2903299513,38cyclictest32534-21chrt22:40:043
2903299513,38cyclictest24743-21chrt21:33:313
2903299513,37cyclictest338-21chrt21:46:003
2903299513,37cyclictest338-21chrt21:46:003
2903299513,37cyclictest31227-21chrt20:40:183
2903299513,37cyclictest31227-21chrt20:40:183
2903299513,37cyclictest29301-21chrt22:34:573
2903299513,37cyclictest29301-21chrt22:34:573
2903299512,39cyclictest28082-21taskset21:39:313
2903299512,38cyclictest29250-21taskset00:22:213
2903299512,38cyclictest29250-21taskset00:22:213
2903299505,32cyclictest13753-21taskset19:49:433
2903299504,37cyclictest20807-21chrt20:10:213
2903299504,36cyclictest16491-21chrt21:19:493
2903299503,37cyclictest20951-21chrt23:15:093
2903299503,37cyclictest20951-21chrt23:15:093
2903299503,37cyclictest12328-21chrt21:12:113
2903299503,37cyclictest12328-21chrt21:12:113
2903299503,35cyclictest23020-21chrt22:24:433
2903299494,36cyclictest24529-21chrt00:14:563
2903299494,35cyclictest5336-21chrt21:55:043
2903299494,35cyclictest5336-21chrt21:55:043
2903299494,35cyclictest19435-21chrt00:05:153
2903299494,34cyclictest29456-21chrt23:29:403
2903299493,35cyclictest31534-21chrt00:25:253
2903299493,34cyclictest27936-21chrt22:32:093
2903299493,34cyclictest11922-21chrt22:05:173
2903299492,38cyclictest11852-21chrt23:53:283
2903299492,36cyclictest32133-21chrt20:45:043
2903299492,36cyclictest3161-21chrt20:55:083
2903299492,36cyclictest3161-21chrt20:55:083
2903299492,36cyclictest2745-21chrt21:50:133
2903299484,33cyclictest24958-21chrt23:20:283
2903299484,33cyclictest18004-21chrt20:00:163
2903299484,33cyclictest18004-21chrt20:00:163
2903299483,36cyclictest22144-21chrt00:10:103
2903299483,35cyclictest31909-21chrt23:33:173
2903299483,35cyclictest31909-21chrt23:33:173
2903299483,34cyclictest4585-21chrt22:47:153
2903299483,34cyclictest15773-21chrt23:05:193
2903299483,34cyclictest15773-21chrt23:05:193
2903299482,36cyclictest13919-21chrt23:55:553
2903299482,36cyclictest13919-21chrt23:55:553
2903299474,33cyclictest11533-21chrt19:40:163
29032994735,8cyclictest451rcuc/319:30:043
2903299473,34cyclictest8641-21chrt21:05:583
2903299473,34cyclictest8641-21chrt21:05:583
2903299473,34cyclictest8641-21chrt21:05:583
2903299473,33cyclictest6684-21chrt23:44:573
2903299473,33cyclictest6684-21chrt23:44:573
2903299472,35cyclictest5323-21chrt23:41:493
2903299472,35cyclictest5323-21chrt23:41:493
2903299472,32cyclictest23875-21taskset20:19:563
2903299464,33cyclictest5105-21taskset21:00:143
2903299464,32cyclictest29237-21taskset20:35:113
2903299464,32cyclictest15545-21chrt21:17:503
2903299463,32cyclictest7354-21chrt22:51:373
2903299463,32cyclictest27369-21chrt20:30:053
2903299463,31cyclictest7276-21chrt19:29:433
2903299462,34cyclictest20715-21chrt21:25:363
2903299453,30cyclictest29767-21taskset19:00:123
29032994527,11cyclictest83222chrt22:00:023
2903299452,31cyclictest14009-21chrt19:50:003
2903299452,31cyclictest14009-21chrt19:50:003
29032994431,9cyclictest451rcuc/319:22:153
29032994430,7cyclictest451rcuc/320:49:493
29032994330,9cyclictest451rcuc/319:14:263
29032994330,9cyclictest451rcuc/319:14:263
2903299403,27cyclictest26575-21taskset20:27:543
2903299402,28cyclictest23006-21taskset20:15:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional