You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 16:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jun 22, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
448299280,0cyclictest0-21swapper/010:55:200
448299273,21cyclictest62550irq/127-eno111:23:100
4482992722,4cyclictest0-21swapper/009:55:010
448299270,23cyclictest30677-21diskmemload11:17:550
449499260,25cyclictest5263-21head09:15:283
449199260,25cyclictest12331-21rm09:52:442
4484992623,2cyclictest3255-21head11:45:291
448299260,25cyclictest0-21swapper/010:34:380
448299260,25cyclictest0-21swapper/009:12:190
448299260,23cyclictest0-21swapper/009:55:120
448299260,1cyclictest27188-21sh10:05:490
448299260,1cyclictest0-21swapper/012:02:010
4494992523,1cyclictest0-21swapper/311:47:253
449499250,24cyclictest30677-21diskmemload12:28:423
449499250,1cyclictest0-21swapper/311:33:563
449199250,24cyclictest30677-21diskmemload10:39:392
449199250,24cyclictest23218-21ssh12:34:202
4484992523,1cyclictest0-21swapper/112:10:241
448499250,24cyclictest30677-21diskmemload10:46:291
448499250,24cyclictest0-21swapper/112:30:301
4482992521,3cyclictest30677-21diskmemload12:24:110
4482992520,4cyclictest0-21swapper/011:46:160
448299250,21cyclictest12182-21ssh11:55:000
448299250,1cyclictest16150-21sh11:57:560
448299250,0cyclictest0-21swapper/011:43:170
4494992422,1cyclictest31095-21rm11:40:433
449499240,23cyclictest30677-21diskmemload09:38:523
449499240,23cyclictest20022-21/usr/sbin/munin09:30:203
449499240,23cyclictest0-21swapper/309:21:393
449199240,24cyclictest0-21swapper/211:37:362
449199240,23cyclictest0-21swapper/211:48:102
449199240,23cyclictest0-21swapper/211:14:162
449199240,21cyclictest0-21swapper/212:13:552
4484992423,1cyclictest0-21swapper/111:55:251
4484992423,1cyclictest0-21swapper/110:53:211
4484992422,1cyclictest19097-21sh12:00:241
4484992422,1cyclictest15744-21apt-get08:40:201
448499240,24cyclictest0-21swapper/110:33:351
448499240,23cyclictest30677-21diskmemload09:24:091
448499240,23cyclictest0-21swapper/111:44:371
448499240,0cyclictest30677-21diskmemload09:46:491
4482992423,1cyclictest30677-21diskmemload09:37:310
4482992423,1cyclictest0-21swapper/009:33:070
4482992422,1cyclictest21405-21ssh12:31:460
4482992421,3cyclictest0-21swapper/010:14:510
4482992420,3cyclictest6713-21sh10:18:000
4482992420,3cyclictest0-21swapper/011:12:050
4482992420,3cyclictest0-21swapper/009:21:230
4482992419,1cyclictest5992-21ssh10:47:450
4482992419,1cyclictest17632-21ssh12:29:020
448299240,24cyclictest0-21swapper/009:44:010
448299240,23cyclictest0-21swapper/012:35:190
448299240,23cyclictest0-21swapper/012:05:270
448299240,23cyclictest0-21swapper/011:06:050
448299240,21cyclictest0-21swapper/011:33:470
448299240,0cyclictest30677-21diskmemload10:01:160
448299240,0cyclictest0-21swapper/011:29:030
448299240,0cyclictest0-21swapper/010:41:250
448299240,0cyclictest0-21swapper/009:16:590
4494992323,0cyclictest30677-21diskmemload10:08:343
4494992323,0cyclictest0-21swapper/311:03:333
4494992322,1cyclictest30677-21diskmemload12:33:093
4494992321,1cyclictest23763-21apt-get11:35:223
4494992321,1cyclictest10249-21ssh10:51:073
4494992321,1cyclictest0-21swapper/311:14:383
4494992321,1cyclictest0-21swapper/310:15:223
4494992321,1cyclictest0-21swapper/310:10:103
4494992320,2cyclictest11066-21ssh10:21:313
449499231,0cyclictest0-21swapper/309:41:403
449499230,2cyclictest12217-21perf11:55:003
449499230,23cyclictest0-21swapper/310:27:173
449499230,23cyclictest0-21swapper/309:47:443
449499230,22cyclictest27373-21ssh11:07:553
449499230,22cyclictest20649-21sh12:01:063
449499230,22cyclictest15007-21sh11:25:353
449499230,22cyclictest11016-21sh11:22:323
449499230,22cyclictest0-21swapper/310:43:403
449499230,0cyclictest0-21swapper/311:56:193
449499230,0cyclictest0-21swapper/311:15:423
4491992323,0cyclictest30677-21diskmemload09:47:392
4491992323,0cyclictest0-21swapper/212:36:482
4491992323,0cyclictest0-21swapper/212:22:392
4491992323,0cyclictest0-21swapper/211:44:382
4491992323,0cyclictest0-21swapper/209:30:202
4491992320,0cyclictest0-21swapper/210:54:152
4491992320,0cyclictest0-21swapper/209:36:202
449199230,2cyclictest2586-21ssh12:15:052
449199230,23cyclictest30677-21diskmemload12:28:422
449199230,23cyclictest0-21swapper/212:00:122
449199230,23cyclictest0-21swapper/211:52:232
449199230,23cyclictest0-21swapper/211:07:112
449199230,22cyclictest7346-21ssh09:17:402
449199230,22cyclictest4961-21ssh11:16:252
449199230,22cyclictest30677-21diskmemload10:25:012
449199230,22cyclictest30677-21diskmemload10:00:322
449199230,22cyclictest10525-21ssh09:20:262
449199230,22cyclictest0-21swapper/210:45:282
4484992323,0cyclictest30677-21diskmemload10:17:271
4484992323,0cyclictest0-21swapper/112:15:301
4484992323,0cyclictest0-21swapper/111:34:031
4484992323,0cyclictest0-21swapper/110:10:041
4484992322,1cyclictest7946-21diskmemload12:20:091
4484992321,1cyclictest24572-21sort12:35:211
4484992320,2cyclictest20661-21awk08:50:001
448499230,2cyclictest6349-21ssh11:18:361
448499230,2cyclictest27077-21ssh10:05:411
448499230,23cyclictest0-21swapper/111:52:001
448499230,23cyclictest0-21swapper/111:06:061
448499230,23cyclictest0-21swapper/110:29:451
448499230,23cyclictest0-21swapper/109:34:231
448499230,22cyclictest27064-21sh12:07:381
448499230,22cyclictest23272-21ssh10:03:051
448499230,22cyclictest17400-21ssh11:29:111
448499230,22cyclictest16840-21ssh10:58:051
448499230,0cyclictest18455-21ssh11:00:171
448499230,0cyclictest0-21swapper/109:11:271
4482992320,3cyclictest0-21swapper/010:50:260
4482992319,0cyclictest0-21swapper/007:50:210
4482992317,1cyclictest0-21swapper/011:03:100
448299230,23cyclictest0-21swapper/011:39:000
448299230,23cyclictest0-21swapper/009:25:490
448299230,22cyclictest0-21swapper/010:37:270
448299230,22cyclictest0-21swapper/009:47:330
448299230,1cyclictest0-21swapper/010:23:150
448299230,0cyclictest0-21swapper/012:16:500
448299230,0cyclictest0-21swapper/010:27:270
4494992222,0cyclictest0-21swapper/307:40:193
4494992220,1cyclictest0-21swapper/312:05:413
4494992220,1cyclictest0-21swapper/310:46:033
4494992220,1cyclictest0-21swapper/310:31:193
4494992220,1cyclictest0-21swapper/309:25:033
4494992220,1cyclictest0-21swapper/307:25:213
449499220,21cyclictest31627-21rm12:10:513
449499220,21cyclictest10275-21sh12:20:573
449499220,21cyclictest0-21swapper/312:35:493
449499220,21cyclictest0-21swapper/310:55:023
449499220,21cyclictest0-21swapper/310:35:113
449499220,21cyclictest0-21swapper/310:03:333
449499220,21cyclictest0-21swapper/307:20:203
449499220,1cyclictest28569-21cron08:00:003
449499220,1cyclictest0-21swapper/309:55:183
449499220,1cyclictest0-21swapper/309:54:003
4491992222,0cyclictest0-21swapper/211:56:412
4491992222,0cyclictest0-21swapper/211:25:412
4491992222,0cyclictest0-21swapper/210:34:062
4491992222,0cyclictest0-21swapper/209:41:322
4491992220,1cyclictest26837-21ssh12:07:202
4491992220,1cyclictest17848-21dump-pmu-power08:45:002
4491992220,1cyclictest0-21swapper/210:10:212
449199220,2cyclictest31015-21awk08:05:012
449199220,22cyclictest880-21kworker/u8:109:55:242
449199220,22cyclictest5676-1kworker/u9:209:12:382
449199220,21cyclictest0-21swapper/210:16:422
449199220,1cyclictest20752-21ssh11:01:012
449199220,1cyclictest14378-21ssh10:55:272
449199220,1cyclictest11369-21ssh11:23:002
449199220,1cyclictest0-21swapper/210:40:082
449199220,1cyclictest0-21swapper/210:20:122
449199220,0cyclictest0-21swapper/211:30:132
449199220,0cyclictest0-21swapper/210:06:112
449199220,0cyclictest0-21swapper/209:27:202
4484992222,0cyclictest0-21swapper/112:26:471
4484992222,0cyclictest0-21swapper/109:55:311
4484992222,0cyclictest0-21swapper/109:38:511
4484992220,1cyclictest16448-21wc07:35:001
4484992220,1cyclictest14044-21perf07:30:011
4484992219,2cyclictest16955-21sh09:26:001
448499220,22cyclictest30677-21diskmemload11:35:371
448499220,22cyclictest30677-21diskmemload10:40:591
448499220,22cyclictest28750-21sh10:39:151
448499220,22cyclictest0-21swapper/109:40:301
448499220,21cyclictest4720-21apt-get07:10:211
448499220,21cyclictest10727-21ssh10:21:031
448499220,21cyclictest0-21swapper/111:20:191
448499220,21cyclictest0-21swapper/109:50:111
448499220,1cyclictest6330-21ssh09:16:071
4482992222,0cyclictest0-21swapper/008:40:200
4482992220,1cyclictest29535-21apt-get12:10:210
4482992220,1cyclictest0-21swapper/008:05:210
4482992219,3cyclictest0-21swapper/007:30:200
448299220,21cyclictest18536-21apt-get08:45:210
448299220,1cyclictest25522-21munin-run09:00:010
4494992119,1cyclictest31030-21ssh09:10:193
449499210,0cyclictest0-21swapper/308:45:213
449199210,20cyclictest18479-21apt-get08:45:022
449199210,20cyclictest14326-21apt-get07:30:202
449199210,0cyclictest9536-21apt-get07:20:202
4484992120,1cyclictest7116-21apt-get07:15:201
4484992120,1cyclictest0-21swapper/111:10:011
4484992119,1cyclictest26211-21basename07:55:001
448499210,0cyclictest28896-21apt-get08:00:221
448299210,20cyclictest5819-21munin-run08:20:010
448299210,20cyclictest0-21swapper/009:05:020
448299210,20cyclictest0-21swapper/008:50:210
448299210,20cyclictest0-21swapper/008:30:210
448299210,1cyclictest19242-21apt-get07:40:180
448299210,0cyclictest0-21swapper/007:25:210
4494992020,0cyclictest0-21swapper/308:50:213
4494992020,0cyclictest0-21swapper/308:30:213
4494992018,1cyclictest0-21swapper/309:05:023
449499200,20cyclictest0-21swapper/308:10:223
449499200,19cyclictest31023-21awk08:05:013
4491992020,0cyclictest0-21swapper/209:00:222
4491992020,0cyclictest0-21swapper/208:50:212
4484992020,0cyclictest25798-21apt-get09:00:221
4484992020,0cyclictest0-21swapper/108:55:211
448499200,20cyclictest0-21swapper/108:35:211
4482992020,0cyclictest0-21swapper/009:00:220
4494991919,0cyclictest23380-21apt-get08:55:213
4491991917,1cyclictest5764-21cron08:20:012
4491991916,2cyclictest8202-21awk08:25:012
4491991916,2cyclictest26206-21perf07:55:002
449199190,18cyclictest605-21avahi-daemon08:15:012
4484991919,0cyclictest26482-21apt-get07:55:221
4484991919,0cyclictest0-21swapper/108:50:211
4484991919,0cyclictest0-21swapper/108:25:221
4484991919,0cyclictest0-21swapper/108:20:201
448499190,18cyclictest30716-21awk09:10:011
4482991919,0cyclictest0-21swapper/008:00:220
4482991919,0cyclictest0-21swapper/007:55:220
4482991917,1cyclictest9536-21apt-get07:20:210
4494991818,0cyclictest0-21swapper/308:40:203
4494991818,0cyclictest0-21swapper/308:20:203
4494991818,0cyclictest0-21swapper/307:30:213
4494991818,0cyclictest0-21swapper/307:15:203
4494991816,1cyclictest5817-21turbostat08:20:013
449499180,17cyclictest0-21swapper/307:10:213
4491991818,0cyclictest0-21swapper/209:10:012
4491991818,0cyclictest0-21swapper/208:55:212
4491991818,0cyclictest0-21swapper/208:35:212
4484991818,0cyclictest3661-21apt-get08:15:201
4484991815,2cyclictest22-21ksoftirqd/107:20:251
4482991817,0cyclictest0-21swapper/008:25:210
4482991816,1cyclictest9225-21apt07:20:010
4494991717,0cyclictest0-21swapper/309:00:223
4494991717,0cyclictest0-21swapper/307:35:203
4491991717,0cyclictest31291-21apt-get08:05:212
4491991715,1cyclictest9239-21perf07:20:012
4491991715,1cyclictest0-21swapper/207:40:182
449199170,16cyclictest5206-21cut07:10:232
4484991717,0cyclictest0-21swapper/108:05:221
4484991717,0cyclictest0-21swapper/107:40:001
448299170,16cyclictest3377-21cron08:15:010
4494991616,0cyclictest0-21swapper/308:05:223
4494991616,0cyclictest0-21swapper/307:45:223
4494991615,0cyclictest0-21swapper/308:25:223
4491991615,1cyclictest0-21swapper/207:45:222
4491991614,1cyclictest606-21dbus-daemon08:00:002
4484991616,0cyclictest0-21swapper/108:30:211
448499150,15cyclictest21359-21perf07:45:001
4482991515,0cyclictest21640-21apt-get07:45:220
448299150,1cyclictest0-21swapper/007:35:230
449499140,14cyclictest0-21swapper/307:50:203
449199140,14cyclictest0-21swapper/208:30:122
449199140,14cyclictest0-21swapper/208:25:112
449199140,0cyclictest0-21swapper/207:28:012
4484991414,0cyclictest0-21swapper/108:10:531
4484991414,0cyclictest0-21swapper/107:45:221
448299140,14cyclictest0-21swapper/008:38:480
448299140,14cyclictest0-21swapper/008:21:150
4494991313,0cyclictest0-21swapper/308:36:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional