You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 04:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Sep 04, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24569215811,105sleep024638-21fschecks_time19:05:240
2540821056,16sleep10-21swapper/119:05:541
25865999462,8cyclictest181rcu_preempt22:15:002
25865999451,17cyclictest18082-21ssh22:27:442
25865999451,17cyclictest18082-21ssh22:27:442
25862999348,13cyclictest15123-21ssh23:14:291
25865999063,8cyclictest181rcu_preempt19:50:332
25862999063,10cyclictest181rcu_preempt23:39:371
25856998917,41cyclictest15-21ksoftirqd/022:50:160
25865998865,12cyclictest0-21swapper/223:14:592
25865998763,14cyclictest0-21swapper/220:00:192
25865998763,14cyclictest0-21swapper/220:00:192
25865998666,10cyclictest0-21swapper/220:45:192
25865998662,12cyclictest0-21swapper/220:25:002
25865998662,12cyclictest0-21swapper/220:25:002
25865998643,13cyclictest359-21snmpd00:23:022
25865998638,9cyclictest181rcu_preempt22:30:082
25865998638,9cyclictest181rcu_preempt22:30:082
25862998553,11cyclictest181rcu_preempt19:15:411
25862998553,11cyclictest181rcu_preempt19:15:411
2585699854,41cyclictest15-21ksoftirqd/019:55:340
25865998464,11cyclictest0-21swapper/223:30:002
25865998444,10cyclictest58-21kcompactd019:45:162
25856998448,10cyclictest181rcu_preempt19:15:260
25856998448,10cyclictest181rcu_preempt19:15:260
25856998447,10cyclictest58-21kcompactd020:35:310
25865998344,9cyclictest181rcu_preempt23:42:132
25862998356,11cyclictest181rcu_preempt22:52:331
25862998344,13cyclictest181rcu_preempt21:28:141
25862998246,14cyclictest31-21ksoftirqd/123:17:291
25865998162,9cyclictest0-21swapper/220:15:332
25865998162,10cyclictest0-21swapper/220:55:182
25865998161,12cyclictest0-21swapper/220:35:192
25856998140,10cyclictest181rcu_preempt21:58:460
25865998042,17cyclictest7682-21if_eth021:20:232
25865997963,9cyclictest0-21swapper/220:05:142
25865997948,7cyclictest181rcu_preempt23:07:392
25865997938,16cyclictest381ktimers/200:15:342
25862997948,8cyclictest181rcu_preempt19:45:091
25856997917,8cyclictest181rcu_preempt22:20:310
25865997861,8cyclictest0-21swapper/219:40:002
25865997861,8cyclictest0-21swapper/219:40:002
25865997856,16cyclictest11469-40mandb00:00:542
25865997856,16cyclictest11469-40mandb00:00:542
25865997846,15cyclictest29190-21kworker/u18:1-events_unbound22:24:072
25862997856,14cyclictest0-21swapper/120:00:331
25862997856,14cyclictest0-21swapper/120:00:331
25862997841,7cyclictest181rcu_preempt21:05:001
25862997841,7cyclictest181rcu_preempt21:05:001
25856997860,12cyclictest524-21in:imuxsock20:04:570
25856997860,12cyclictest524-21in:imuxsock20:04:570
25856997845,11cyclictest25171-21/usr/sbin/munin23:30:110
25856997825,8cyclictest181rcu_preempt20:34:560
25856997824,21cyclictest15-21ksoftirqd/023:39:370
25865997761,9cyclictest0-21swapper/222:49:582
25865997761,9cyclictest0-21swapper/222:49:582
25865997759,10cyclictest317-21dbus-daemon21:04:582
25865997759,10cyclictest317-21dbus-daemon21:04:582
25865997758,15cyclictest29190-21kworker/u18:1-writeback21:36:362
25862997746,8cyclictest181rcu_preempt00:00:301
25862997746,8cyclictest181rcu_preempt00:00:301
25862997735,11cyclictest181rcu_preempt20:50:301
25862997735,11cyclictest181rcu_preempt20:50:301
25856997761,10cyclictest200-21systemd-journal00:30:290
25856997746,10cyclictest21716-21kworker/u18:0-rpciod00:38:270
25856997742,7cyclictest181rcu_preempt22:41:000
46762760,5sleep14678-21idleruntime-cro00:39:561
25865997647,22cyclictest28804-21switchtime19:15:332
25865997647,22cyclictest28804-21switchtime19:15:332
25862997650,17cyclictest8565-21kworker/u19:2+flush-179:020:15:001
25862997635,11cyclictest181rcu_preempt22:20:211
25862997630,30cyclictest3913-21cat19:40:011
25862997630,30cyclictest3913-21cat19:40:011
25856997645,8cyclictest181rcu_preempt21:39:020
25856997644,8cyclictest181rcu_preempt22:27:450
25856997644,8cyclictest181rcu_preempt22:27:450
25856997640,8cyclictest181rcu_preempt21:22:590
25856997639,12cyclictest15-21ksoftirqd/023:50:360
25856997637,10cyclictest58-21kcompactd022:11:150
25865997560,7cyclictest0-21swapper/220:45:002
25865997542,10cyclictest25849-21cyclictest00:04:132
25865997541,8cyclictest181rcu_preempt22:55:552
25865997536,16cyclictest569-21diskmemload22:04:192
25865997535,7cyclictest181rcu_preempt23:34:582
25862997559,10cyclictest31141-21cpu00:30:151
25862997554,15cyclictest569-21diskmemload00:01:101
25862997551,9cyclictest181rcu_preempt00:20:211
25862997546,8cyclictest19866-21ssh21:40:001
25862997539,15cyclictest181rcu_preempt22:33:591
25862997539,15cyclictest181rcu_preempt22:33:591
25856997541,10cyclictest58-21kcompactd020:10:150
25856997540,11cyclictest25849-21cyclictest23:48:390
301192740,5sleep030122-21grep22:45:330
301192740,5sleep030122-21grep22:45:330
25865997450,14cyclictest0-21swapper/219:10:022
25865997441,7cyclictest181rcu_preempt22:50:302
25862997459,9cyclictest17787-21munin-run00:09:561
25862997459,9cyclictest17787-21munin-run00:09:561
25862997453,15cyclictest22819-21switchtime23:25:311
25862997452,7cyclictest181rcu_preempt21:25:001
25862997435,11cyclictest181rcu_preempt21:56:481
25856997441,12cyclictest25849-21cyclictest21:28:360
25856997439,7cyclictest181rcu_preempt22:37:380
25856997430,22cyclictest181rcu_preempt00:15:120
2587699736,49cyclictest0-21swapper/322:35:173
25865997337,22cyclictest20293-21grep21:40:212
25862997354,13cyclictest18963-21ssh23:20:141
25862997353,8cyclictest31-21ksoftirqd/122:11:461
25862997353,7cyclictest181rcu_preempt00:15:311
25862997340,11cyclictest181rcu_preempt23:33:381
25862997337,7cyclictest181rcu_preempt21:34:591
25862997337,7cyclictest181rcu_preempt21:34:591
25856997354,13cyclictest11904-21entropy00:00:270
25856997354,13cyclictest11904-21entropy00:00:270
25856997353,14cyclictest16206-21sh23:15:250
25856997338,11cyclictest569-21diskmemload21:10:560
2522727310,39sleep30-21swapper/319:05:433
25865997257,9cyclictest15766-21sh23:15:142
25865997236,11cyclictest181rcu_preempt21:45:572
25865997236,11cyclictest181rcu_preempt21:45:572
25862997246,10cyclictest27873-21ssh22:42:491
25862997244,19cyclictest27146-21sh21:50:351
25862997238,7cyclictest181rcu_preempt21:40:221
25856997241,21cyclictest863-21ntpq22:00:280
25856997238,28cyclictest343-21runrttasks22:15:240
25856997237,11cyclictest12679-21proc_pri00:01:050
25856997226,19cyclictest32207-21ntp_kernel_pll_21:05:460
25856997226,19cyclictest32207-21ntp_kernel_pll_21:05:460
2585699722,30cyclictest15-21ksoftirqd/000:27:260
25865997155,10cyclictest526-21rs:main2
25865997152,11cyclictest3754-21fschecks_time22:05:212
25865997145,8cyclictest181rcu_preempt23:01:212
25865997141,10cyclictest12826-21ssh22:20:002
25865997136,7cyclictest181rcu_preempt23:50:352
25862997149,9cyclictest181rcu_preempt22:19:151
25862997146,19cyclictest25527-21idleruntime-cro22:39:561
25862997141,22cyclictest21622-21latency_hist20:34:591
25862997128,29cyclictest5987-21cat23:00:001
25856997158,9cyclictest25849-21cyclictest19:37:100
25856997158,9cyclictest25849-21cyclictest19:37:100
25856997157,9cyclictest0-21swapper/019:21:080
25856997157,9cyclictest0-21swapper/019:21:080
25856997153,12cyclictest326-21systemd-logind22:09:570
25856997151,7cyclictest0-21swapper/000:10:210
25856997139,10cyclictest29190-21kworker/u18:1-rpciod23:10:250
25856997133,7cyclictest181rcu_preempt23:03:130
25856997125,21cyclictest181rcu_preempt20:05:350
25865997041,8cyclictest27888-21/usr/sbin/munin00:25:302
25865997041,8cyclictest181rcu_preempt19:59:072
25865997039,8cyclictest181rcu_preempt21:32:232
25865997039,8cyclictest181rcu_preempt21:32:232
25862997050,14cyclictest19841-21kworker/u17:1-writeback23:45:191
25862997045,7cyclictest181rcu_preempt19:14:581
25856997040,12cyclictest181rcu_preempt23:25:260
25856997036,10cyclictest181rcu_preempt21:34:540
25856997036,10cyclictest181rcu_preempt21:34:540
25865996953,10cyclictest12518-21ssh21:28:022
25865996948,15cyclictest31251-21latency_hist19:25:002
25865996948,15cyclictest31251-21latency_hist19:25:002
25865996937,8cyclictest181rcu_preempt21:50:162
25865996937,23cyclictest26698-21switchtime22:40:322
25862996949,8cyclictest181rcu_preempt23:05:241
25862996941,13cyclictest5103-21ssh22:07:021
25862996940,23cyclictest32405-21threads23:40:321
25862996937,8cyclictest181rcu_preempt00:26:151
25862996935,9cyclictest181rcu_preempt21:15:221
25862996935,9cyclictest181rcu_preempt21:15:221
25856996955,9cyclictest25849-21cyclictest21:04:300
25856996955,9cyclictest25849-21cyclictest21:04:300
25856996947,15cyclictest0-21swapper/022:30:280
25856996947,15cyclictest0-21swapper/022:30:280
25856996941,10cyclictest58-21kcompactd000:05:060
25856996941,10cyclictest58-21kcompactd000:05:060
25856996925,9cyclictest181rcu_preempt20:55:000
25856996925,9cyclictest181rcu_preempt20:55:000
25865996845,17cyclictest19432-21ntp_kernel_pll_23:20:262
25865996843,8cyclictest181rcu_preempt00:09:182
25865996843,8cyclictest181rcu_preempt00:09:182
25865996839,8cyclictest181rcu_preempt20:32:002
25865996837,7cyclictest181rcu_preempt23:46:342
25865996834,8cyclictest181rcu_preempt19:40:222
25865996834,8cyclictest181rcu_preempt19:40:222
25865996834,7cyclictest181rcu_preempt00:39:302
25862996853,9cyclictest29847-21ssh22:45:301
25862996853,9cyclictest29847-21ssh22:45:301
25862996848,8cyclictest31-21ksoftirqd/122:02:141
25862996840,16cyclictest181rcu_preempt20:05:231
25862996836,9cyclictest181rcu_preempt20:55:191
25856996834,10cyclictest181rcu_preempt21:42:180
25865996749,12cyclictest358-21ntpd22:36:072
25865996747,8cyclictest181rcu_preempt19:25:232
25862996746,15cyclictest18404-21latency_hist20:25:001
25862996746,15cyclictest18404-21latency_hist20:25:001
25862996739,20cyclictest1836-21latency_hist19:35:001
25862996739,20cyclictest1836-21latency_hist19:35:001
25862996734,8cyclictest181rcu_preempt20:39:591
2586299673,42cyclictest1225-21grep21:10:201
25862996734,12cyclictest181rcu_preempt00:12:001
25862996728,27cyclictest19931-21cat20:29:591
25862996728,27cyclictest19931-21cat20:29:591
25856996747,7cyclictest181rcu_preempt23:20:470
25856996744,15cyclictest0-21swapper/000:20:290
25856996737,9cyclictest181rcu_preempt21:16:470
25856996737,9cyclictest181rcu_preempt21:16:470
25865996646,14cyclictest556-21latency_hist21:10:002
25865996646,14cyclictest556-21latency_hist21:10:002
25865996640,20cyclictest29789-21sh21:55:202
25865996636,9cyclictest181rcu_preempt23:35:462
25865996632,16cyclictest0-21swapper/200:12:202
25865996631,23cyclictest4322-21grep21:15:192
25865996631,23cyclictest4322-21grep21:15:192
25865996617,9cyclictest381ktimers/221:10:242
25862996651,9cyclictest18960-21munin-run22:29:561
25862996651,9cyclictest18960-21munin-run22:29:561
25862996637,7cyclictest181rcu_preempt23:00:141
25862996637,21cyclictest19841-21kworker/u17:1-xprtiod23:50:071
25862996636,8cyclictest181rcu_preempt19:24:591
25862996636,8cyclictest181rcu_preempt19:24:591
25862996627,26cyclictest31865-21uniq21:05:341
25862996627,26cyclictest31865-21uniq21:05:341
25862996618,21cyclictest0-21swapper/120:40:301
25856996641,19cyclictest26524-21kworker/u17:0+nfsiod21:53:360
25856996641,18cyclictest0-21swapper/023:40:200
25856996635,9cyclictest181rcu_preempt20:19:590
25865996531,13cyclictest181rcu_preempt20:50:072
25865996531,13cyclictest181rcu_preempt20:50:072
25865996526,19cyclictest1855-21idleruntime-cro19:34:572
25865996526,19cyclictest1855-21idleruntime-cro19:34:572
25862996541,16cyclictest0-21swapper/119:44:561
25862996541,16cyclictest0-21swapper/119:44:561
25862996537,11cyclictest181rcu_preempt21:48:171
25862996537,11cyclictest181rcu_preempt21:48:171
25862996533,7cyclictest181rcu_preempt19:25:231
25862996531,14cyclictest26348-21latency_hist20:49:591
25856996552,9cyclictest25849-21cyclictest23:07:380
25865996439,14cyclictest0-21swapper/219:10:212
2586299643,24cyclictest31-21ksoftirqd/119:52:011
25862996427,8cyclictest181rcu_preempt19:55:311
25856996445,13cyclictest1843-21grep19:34:590
25856996445,13cyclictest1843-21grep19:34:590
25856996350,9cyclictest25849-21cyclictest20:55:320
25856996336,20cyclictest13572-21kworker/u17:2+nfsiod21:48:330
25856996336,20cyclictest13572-21kworker/u17:2+nfsiod21:48:330
25856996318,30cyclictest317-21dbus-daemon20:49:580
2587699623,42cyclictest17612-21chrt21:35:313
2587699623,41cyclictest15481-21chrt20:15:193
25876996231,20cyclictest30391-21chrt21:00:303
25876996231,20cyclictest30391-21chrt21:00:303
25856996233,9cyclictest181rcu_preempt22:58:440
25876996125,23cyclictest16494-21chrt21:34:583
25876996125,23cyclictest16494-21chrt21:34:583
25876996124,24cyclictest14230-21taskset22:21:013
25876996122,25cyclictest7063-21taskset23:51:563
25876996114,30cyclictest0-21swapper/300:10:153
25856996147,9cyclictest0-21swapper/020:22:230
25856996147,9cyclictest0-21swapper/020:22:230
25856996147,7cyclictest0-21swapper/019:54:560
2585699612,33cyclictest26847-21wc19:10:310
2587699604,36cyclictest975-21chrt21:10:143
25876996026,21cyclictest32677-21chrt23:40:383
2587699602,44cyclictest23563-21chrt20:40:173
25876996024,24cyclictest9755-21taskset22:15:093
25876996024,23cyclictest13910-21chrt00:03:113
25865996041,14cyclictest25849-21cyclictest20:25:312
25865996041,14cyclictest25849-21cyclictest20:25:312
25862996012,21cyclictest31-21ksoftirqd/120:15:191
25856996044,10cyclictest27643-21munin-node20:25:140
25856996044,10cyclictest27643-21munin-node20:25:140
2585699603,44cyclictest6922-21idleruntime-cro19:49:560
2585699603,27cyclictest4254-21tune2fs19:40:200
2585699603,27cyclictest4254-21tune2fs19:40:200
2587699594,44cyclictest0-21swapper/319:35:143
2587699594,44cyclictest0-21swapper/319:35:143
2587699594,37cyclictest11325-21chrt20:00:333
2587699594,37cyclictest11325-21chrt20:00:333
2587699593,41cyclictest16856-21taskset00:07:363
2587699593,41cyclictest16856-21taskset00:07:363
25876995927,20cyclictest10296-21chrt23:57:073
25876995927,20cyclictest10296-21chrt23:57:073
25876995925,22cyclictest31403-21chrt00:30:223
25876995925,22cyclictest30607-21chrt21:55:373
25876995925,22cyclictest29610-21chrt22:45:243
25876995925,22cyclictest29610-21chrt22:45:243
25876995925,22cyclictest23901-21chrt23:27:343
25876995925,22cyclictest17442-21chrt20:20:293
25876995925,22cyclictest17442-21chrt20:20:293
25876995924,23cyclictest12205-21chrt20:05:183
25876995924,22cyclictest30032-21chrt23:37:023
25876995924,21cyclictest27425-21chrt22:41:393
25876995924,21cyclictest17504-21chrt23:17:293
25876995924,21cyclictest16323-21chrt22:25:183
25876995924,21cyclictest16323-21chrt22:25:183
25876995921,23cyclictest29398-21taskset19:19:383
25876995921,23cyclictest29398-21taskset19:19:383
25865995941,13cyclictest14275-21mailstats20:10:292
2587699583,38cyclictest27980-21taskset21:52:003
25876995826,20cyclictest25494-21chrt20:45:283
25876995825,22cyclictest24905-21chrt00:20:173
25876995825,22cyclictest18646-21chrt20:25:153
25876995825,22cyclictest18646-21chrt20:25:153
25876995825,21cyclictest2471-21chrt22:54:363
25876995824,22cyclictest8876-21chrt21:21:493
25876995824,22cyclictest12692-21chrt23:10:203
25876995824,21cyclictest19765-21chrt23:20:333
25876995824,20cyclictest14168-21chrt20:10:253
25876995823,23cyclictest25921-21chrt23:30:333
25876995823,23cyclictest10445-21chrt23:05:383
25876995823,21cyclictest5264-21chrt21:15:453
25876995823,21cyclictest5264-21chrt21:15:453
25876995823,20cyclictest21861-21chrt20:35:153
25876995822,24cyclictest31675-21taskset21:05:123
25876995822,24cyclictest31675-21taskset21:05:123
25876995821,25cyclictest20153-21taskset21:40:173
2585699583,45cyclictest415-21latency_hist19:30:000
25876995723,22cyclictest4640-21chrt22:57:033
25876995723,20cyclictest9016-21chrt23:04:573
25876995722,21cyclictest26841-21taskset19:10:313
25876995721,24cyclictest3590-21taskset00:37:183
2587699563,38cyclictest25218-21taskset21:48:033
2587699563,38cyclictest25218-21taskset21:48:033
2587699563,35cyclictest9682-21taskset19:55:343
25876995624,20cyclictest29921-21chrt19:20:193
25876995624,20cyclictest29921-21chrt19:20:193
25876995624,19cyclictest5060-21chrt19:41:503
25876995624,19cyclictest5060-21chrt19:41:503
25876995624,19cyclictest27657-21chrt20:51:523
25876995624,19cyclictest27657-21chrt20:51:523
25876995623,22cyclictest1672-21chrt19:32:593
25876995623,22cyclictest1672-21chrt19:32:593
25876995623,21cyclictest4764-21chrt23:49:093
25876995623,21cyclictest29572-21chrt00:26:573
25876995621,23cyclictest12618-21chrt21:28:183
25876995620,22cyclictest31911-21chrt19:25:293
25876995619,24cyclictest8404-21taskset19:53:323
2585699563,29cyclictest200-21systemd-journal20:40:000
2587699554,37cyclictest22658-21chrt00:15:393
2587699554,33cyclictest1035-21chrt22:00:313
25876995524,20cyclictest8264-21chrt22:12:013
25876995523,20cyclictest20093-21chrt20:30:053
25876995521,23cyclictest4842-21chrt22:06:223
25876995521,22cyclictest29405-21chrt20:58:403
25876995520,22cyclictest6749-21chrt19:47:533
25876995421,21cyclictest21991-21chrt22:34:383
25876995421,21cyclictest21991-21chrt22:34:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional