You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 19:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Mar 15, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1345099250,24cyclictest0-21swapper/209:34:102
1344999250,24cyclictest0-21swapper/112:12:061
1344999250,24cyclictest0-21swapper/111:10:571
1344999250,24cyclictest0-21swapper/110:53:401
1344499250,24cyclictest62550irq/127-eno110:19:550
13451992423,0cyclictest7199-21diskmemload10:47:193
13451992422,1cyclictest0-21swapper/309:42:433
13451992422,1cyclictest0-21swapper/309:27:223
13451992419,0cyclictest151rcu_preempt09:45:233
1345199240,24cyclictest7199-21diskmemload11:10:573
1345199240,24cyclictest7199-21diskmemload10:17:293
1345199240,24cyclictest17837-21ssh10:53:403
1345199240,23cyclictest7199-21diskmemload11:05:083
1345199240,23cyclictest28554-21ssh09:30:263
1345199240,23cyclictest18929-21ssh11:26:343
1345199240,23cyclictest15926-21ssh09:17:203
1345199240,23cyclictest0-21swapper/312:11:593
1345199240,23cyclictest0-21swapper/310:10:453
1345199240,23cyclictest0-21swapper/310:05:063
1345199240,23cyclictest0-21swapper/309:38:193
13450992423,1cyclictest28-21ksoftirqd/212:27:372
13450992422,1cyclictest21113-21ssh10:26:152
1345099240,24cyclictest0-21swapper/209:39:132
1345099240,23cyclictest7199-21diskmemload11:44:572
1345099240,23cyclictest3268-21latency_hist10:40:012
1345099240,23cyclictest0-21swapper/211:29:502
1345099240,0cyclictest0-21swapper/211:24:002
13449992423,1cyclictest0-21swapper/111:06:441
13449992423,0cyclictest0-21swapper/111:37:191
1344999240,24cyclictest0-21swapper/110:17:291
1344999240,23cyclictest9357-21ssh12:18:341
1344999240,23cyclictest9357-21ssh12:18:341
1344999240,23cyclictest0-21swapper/109:49:011
1344999240,23cyclictest0-21swapper/109:34:211
1344999240,23cyclictest0-21swapper/109:17:201
1344999240,0cyclictest7199-21diskmemload09:58:001
1344999240,0cyclictest0-21swapper/110:20:261
1344999240,0cyclictest0-21swapper/109:42:411
13444992423,1cyclictest0-21swapper/009:28:520
13444992421,2cyclictest23609-21tail12:32:120
13444992421,2cyclictest0-21swapper/012:14:140
1344499240,23cyclictest7199-21diskmemload12:26:030
1344499240,23cyclictest3575-21apt-get07:57:040
1344499240,23cyclictest14857-21ssh11:52:370
1344499240,23cyclictest0-21swapper/011:33:470
1344499240,23cyclictest0-21swapper/011:17:500
1344499240,22cyclictest0-21swapper/010:36:010
1344499240,22cyclictest0-21swapper/009:59:020
1344499240,1cyclictest27812-21ssh11:02:590
1344499240,0cyclictest20250-21apt-get10:57:030
1344499240,0cyclictest0-21swapper/010:41:240
1344499240,0cyclictest0-21swapper/010:41:240
13451992323,0cyclictest7199-21diskmemload11:31:273
13451992323,0cyclictest0-21swapper/311:57:043
13451992321,1cyclictest0-21swapper/309:10:413
1345199230,2cyclictest6560-21ssh12:17:003
1345199230,2cyclictest6560-21ssh12:17:003
1345199230,22cyclictest606-21dbus-daemon07:20:003
1345199230,22cyclictest29346-21ssh12:37:323
1345199230,22cyclictest14225-21apt-get07:12:033
1345199230,0cyclictest7199-21diskmemload12:26:473
1345199230,0cyclictest0-21swapper/311:23:023
1345199230,0cyclictest0-21swapper/309:58:003
13450992322,1cyclictest17372-21apt-get11:56:152
13450992321,1cyclictest0-21swapper/211:30:402
13450992321,1cyclictest0-21swapper/210:22:212
13450992321,1cyclictest0-21swapper/210:07:572
13450992321,1cyclictest0-21swapper/209:20:342
13450992321,0cyclictest0-21swapper/209:58:072
1345099231,1cyclictest7194-21needreboot10:12:092
1345099230,2cyclictest28050-21apt09:30:002
1345099230,2cyclictest11286-21ssh09:13:152
1345099230,23cyclictest7199-21diskmemload09:19:532
1345099230,23cyclictest23290-21ssh10:59:072
1345099230,23cyclictest0-21swapper/212:39:132
1345099230,23cyclictest0-21swapper/212:09:132
1345099230,23cyclictest0-21swapper/209:41:472
1345099230,22cyclictest15518-21dump-pmu-power12:25:012
1345099230,22cyclictest0-21swapper/211:00:012
1345099230,0cyclictest7199-21diskmemload10:47:392
1345099230,0cyclictest0-21swapper/211:35:022
1345099230,0cyclictest0-21swapper/210:02:072
13449992323,0cyclictest0-21swapper/112:04:191
13449992323,0cyclictest0-21swapper/111:31:271
13449992322,1cyclictest0-21swapper/109:27:221
13449992321,1cyclictest0-21swapper/110:46:281
13449992321,1cyclictest0-21swapper/109:23:381
13449992321,1cyclictest0-21swapper/109:10:411
1344999230,2cyclictest7460-21ssh11:46:531
1344999230,23cyclictest7199-21diskmemload10:10:451
1344999230,23cyclictest0-21swapper/109:38:191
1344999230,22cyclictest23789-21ssh10:27:341
1344999230,22cyclictest19307-21sh10:55:401
1344999230,22cyclictest18381-21diskmemload11:25:361
1344999230,1cyclictest0-21swapper/112:23:021
1344999230,1cyclictest0-21swapper/107:20:001
1344999230,0cyclictest7199-21diskmemload10:05:061
1344999230,0cyclictest0-21swapper/112:30:411
1344999230,0cyclictest0-21swapper/112:26:471
1344999230,0cyclictest0-21swapper/111:23:021
13444992321,1cyclictest20076-21ssh09:52:550
13444992321,1cyclictest11136-21ssh09:13:020
1344499230,2cyclictest9736-21cron10:15:000
1344499230,2cyclictest14851-21ssh12:24:020
1344499230,23cyclictest0-21swapper/011:36:110
1344499230,23cyclictest0-21swapper/011:14:190
1344499230,23cyclictest0-21swapper/009:30:390
1344499230,22cyclictest606-21dbus-daemon08:15:010
1344499230,22cyclictest28928-21if_eno110:02:060
1344499230,22cyclictest17151-21rm11:55:470
1344499230,22cyclictest10210-21sh12:19:530
1344499230,22cyclictest10210-21sh12:19:530
1344499230,22cyclictest0-21swapper/010:25:250
1344499230,1cyclictest6360-21ssh09:40:170
1344499230,0cyclictest7199-21diskmemload10:54:460
1344499230,0cyclictest0-21swapper/012:05:100
1344499230,0cyclictest0-21swapper/009:35:370
1344499230,0cyclictest0-21swapper/009:22:190
13451992222,0cyclictest0-21swapper/312:09:523
1345199220,2cyclictest16344-21rm11:54:583
1345199220,22cyclictest0-21swapper/311:36:373
1345199220,21cyclictest7199-21diskmemload12:30:523
1345199220,21cyclictest7199-21diskmemload11:40:103
1345199220,21cyclictest21541-21rm09:23:043
1345199220,21cyclictest11238-21rm11:17:583
1345199220,21cyclictest0-21swapper/311:00:013
1345199220,21cyclictest0-21swapper/310:55:403
1345199220,1cyclictest7199-21diskmemload10:35:143
1345199220,1cyclictest21291-21kworker/u8:210:41:253
1345199220,1cyclictest21291-21kworker/u8:210:41:253
1345199220,1cyclictest14190-21ssh12:23:023
1345199220,1cyclictest0-21swapper/310:25:023
1345199220,0cyclictest0-21swapper/311:45:073
1345199220,0cyclictest0-21swapper/308:27:033
13450992222,0cyclictest7199-21diskmemload09:52:232
13450992222,0cyclictest25519-1kworker/u9:211:46:272
13450992222,0cyclictest0-21swapper/212:30:062
13450992222,0cyclictest0-21swapper/212:15:392
13450992222,0cyclictest0-21swapper/212:15:392
13450992222,0cyclictest0-21swapper/212:12:232
13450992220,1cyclictest7948-21cron08:05:002
13450992220,1cyclictest7199-21diskmemload10:41:152
13450992220,1cyclictest7199-21diskmemload10:41:152
13450992220,1cyclictest0-21swapper/212:00:172
13450992220,1cyclictest0-21swapper/211:11:432
13450992220,1cyclictest0-21swapper/211:05:232
13450992218,4cyclictest0-21swapper/210:17:022
1345099220,22cyclictest0-21swapper/211:15:312
1345099220,22cyclictest0-21swapper/210:50:302
1345099220,22cyclictest0-21swapper/209:48:592
1345099220,21cyclictest0-21swapper/210:31:242
1345099220,0cyclictest0-21swapper/211:53:352
13449992222,0cyclictest7199-21diskmemload12:35:371
13449992222,0cyclictest0-21swapper/111:40:411
13449992221,1cyclictest9282-21kworker/1:010:36:391
13449992220,1cyclictest22422-21awk08:35:011
13449992220,1cyclictest0-21swapper/111:50:041
13449992220,1cyclictest0-21swapper/110:32:061
13449992220,1cyclictest0-21swapper/107:22:041
1344999220,22cyclictest31382-21kworker/u8:110:40:141
1344999220,22cyclictest31382-21kworker/u8:110:40:141
1344999220,22cyclictest26965-21ssh10:00:061
1344999220,22cyclictest16506-21rm09:50:011
1344999220,21cyclictest24162-21ssh11:00:011
1344999220,21cyclictest0-21swapper/111:17:581
1344999220,21cyclictest0-21swapper/107:12:031
1344999220,1cyclictest17757-21sh11:56:471
1344999220,0cyclictest17996-21apt-get08:27:031
1344999220,0cyclictest0-21swapper/112:06:231
13444992222,0cyclictest0-21swapper/012:00:130
13444992222,0cyclictest0-21swapper/011:25:170
13444992220,1cyclictest0-21swapper/010:07:050
1344499220,22cyclictest13919-21diskmemload09:16:590
1344499220,21cyclictest7199-21diskmemload12:35:120
1344499220,21cyclictest7199-21diskmemload09:45:230
1344499220,21cyclictest19983-21munin-run08:30:010
1344499220,21cyclictest19123-21sh10:23:320
1344499220,1cyclictest29852-21diskmemload11:05:490
1344499220,0cyclictest7199-21diskmemload11:45:200
1344499220,0cyclictest7199-21diskmemload10:30:310
1344499220,0cyclictest0-21swapper/010:47:440
13451992120,1cyclictest5239-21apt-get09:07:043
13451992120,1cyclictest0-21swapper/308:02:043
13451992120,0cyclictest0-21swapper/307:22:043
1345199210,21cyclictest0-21swapper/310:30:143
1345199210,20cyclictest5581-21ls08:00:003
1345199210,20cyclictest2449-21apt-get09:02:033
1345199210,20cyclictest0-21swapper/307:52:043
1345199210,20cyclictest0-21swapper/307:37:033
1345199210,20cyclictest0-21swapper/307:32:033
1345199210,0cyclictest0-21swapper/312:00:083
1345199210,0cyclictest0-21swapper/308:10:003
1345099210,20cyclictest0-21swapper/207:10:022
13449992120,1cyclictest22841-21apt-get08:37:021
13449992120,1cyclictest0-21swapper/107:47:041
1344999210,21cyclictest0-21swapper/109:02:031
1344999210,21cyclictest0-21swapper/107:52:041
1344999210,20cyclictest26386-21apt-get07:37:031
1344999210,20cyclictest0-21swapper/108:00:001
1344999210,0cyclictest0-21swapper/108:10:001
1344499214,1cyclictest0-21swapper/007:10:010
1344499210,1cyclictest24851-21tr08:40:000
1344499210,0cyclictest5992-21apt-get08:02:050
13451992020,0cyclictest0-21swapper/308:37:023
13451992020,0cyclictest0-21swapper/307:47:043
13451992019,1cyclictest30050-21apt-get08:52:043
13450992020,0cyclictest0-21swapper/208:57:042
13450992020,0cyclictest0-21swapper/207:22:042
1345099200,0cyclictest0-21swapper/208:32:032
1345099200,0cyclictest0-21swapper/207:47:042
1345099200,0cyclictest0-21swapper/207:37:032
13449992020,0cyclictest0-21swapper/109:07:041
13449992020,0cyclictest0-21swapper/108:02:041
1344999200,0cyclictest0-21swapper/107:32:031
13444992020,0cyclictest0-21swapper/008:32:030
13444992018,1cyclictest0-21swapper/008:55:000
1344499200,0cyclictest0-21swapper/008:42:040
13451991916,2cyclictest27235-21ls08:45:003
1345199190,0cyclictest0-21swapper/308:22:483
13450991919,0cyclictest0-21swapper/209:07:042
13449991919,0cyclictest27657-21apt-get08:47:041
13449991919,0cyclictest0-21swapper/108:52:041
13444991919,0cyclictest0-21swapper/008:22:020
13444991919,0cyclictest0-21swapper/007:25:010
1344499190,18cyclictest0-21swapper/007:32:030
13451991818,0cyclictest0-21swapper/308:47:043
13451991818,0cyclictest0-21swapper/307:27:033
13450991818,0cyclictest0-21swapper/208:42:052
13450991817,0cyclictest15601-21apt-get08:22:022
13450991816,1cyclictest32046-21munin-run08:55:002
13449991818,0cyclictest21432-21apt-get07:27:031
13449991818,0cyclictest0-21swapper/108:12:031
13449991817,1cyclictest25261-21apt-get08:42:041
13451991717,0cyclictest0-21swapper/308:12:033
13450991717,0cyclictest0-21swapper/207:27:032
13450991716,0cyclictest0-21swapper/207:32:032
13450991715,1cyclictest271rcuc/208:00:002
13450991715,1cyclictest18587-21plymouth07:20:002
13444991717,0cyclictest0-21swapper/009:02:030
13444991717,0cyclictest0-21swapper/007:42:030
13444991716,1cyclictest0-21swapper/007:37:030
1344499170,16cyclictest32444-21apt-get08:57:040
13450991616,0cyclictest0-21swapper/209:02:032
13450991614,1cyclictest10382-21perf08:10:002
13450991614,1cyclictest0-21swapper/208:37:062
13449991616,0cyclictest0-21swapper/108:22:021
13444991614,1cyclictest1698-21perl07:52:060
1344499160,15cyclictest23476-21munin-run07:30:010
13450991515,0cyclictest0-21swapper/208:27:032
13450991515,0cyclictest0-21swapper/207:52:042
13450991513,1cyclictest0-21swapper/208:47:052
13449991513,1cyclictest30795-21perf07:45:011
13444991513,1cyclictest16860-21cat07:17:040
1345199140,14cyclictest0-21swapper/307:40:493
1345199140,0cyclictest0-21swapper/308:55:373
1345199140,0cyclictest0-21swapper/308:15:543
1345099140,0cyclictest0-21swapper/208:16:482
1345099140,0cyclictest0-21swapper/208:10:232
1345099140,0cyclictest0-21swapper/207:40:082
13449991414,0cyclictest0-21swapper/108:55:181
13449991414,0cyclictest0-21swapper/108:15:231
13444991414,0cyclictest0-21swapper/009:05:430
13444991414,0cyclictest0-21swapper/008:45:060
13444991414,0cyclictest0-21swapper/007:46:140
1344499140,14cyclictest0-21swapper/008:05:020
1344499140,0cyclictest0-21swapper/008:16:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional