You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 15:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Jul 09, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21620992624,1cyclictest0-21swapper/111:26:521
21617992624,1cyclictest30969-21cron08:35:010
2162999250,24cyclictest17613-21ssh11:34:463
2162499250,24cyclictest25565-21ssh10:16:002
2162099250,2cyclictest22220-21ssh10:41:441
2162099250,24cyclictest15811-21diskmemload09:12:471
2162099250,24cyclictest0-21swapper/111:02:511
2162099250,24cyclictest0-21swapper/110:05:411
2162099250,1cyclictest7480-1kworker/u9:011:11:571
2162099250,0cyclictest0-21swapper/112:17:161
21617992523,1cyclictest0-21swapper/011:43:340
2161799250,25cyclictest15811-21diskmemload12:06:030
2161799250,24cyclictest15811-21diskmemload11:56:070
2161799250,24cyclictest0-21swapper/010:16:020
2161799250,1cyclictest0-21swapper/011:46:320
21629992424,0cyclictest0-21swapper/312:17:163
21629992422,1cyclictest14138-21sh10:05:413
2162999240,1cyclictest30292-21ssh09:51:453
2162999240,1cyclictest15811-21diskmemload11:09:233
21624992423,1cyclictest0-21swapper/212:14:142
21624992421,3cyclictest0-21swapper/211:55:402
2162499240,23cyclictest6985-21ssh09:30:302
2162499240,23cyclictest32218-21sh09:52:012
2162499240,1cyclictest24741-21sh11:40:492
21620992423,1cyclictest0-21swapper/112:04:151
2162099240,23cyclictest0-21swapper/110:20:241
2162099240,0cyclictest0-21swapper/110:47:581
21617992421,2cyclictest4127-21apt-config10:25:000
2161799240,23cyclictest17508-21sh11:05:570
2161799240,23cyclictest15811-21diskmemload10:50:480
2161799240,23cyclictest0-21swapper/012:27:170
2161799240,23cyclictest0-21swapper/012:16:340
2161799240,23cyclictest0-21swapper/010:21:200
2161799240,23cyclictest0-21swapper/010:04:040
2161799240,1cyclictest19887-21sh12:33:140
2161799240,0cyclictest15811-21diskmemload11:33:220
21629992323,0cyclictest15811-21diskmemload10:13:503
21629992323,0cyclictest0-21swapper/311:29:133
21629992323,0cyclictest0-21swapper/311:11:573
21629992323,0cyclictest0-21swapper/310:52:353
21629992323,0cyclictest0-21swapper/310:33:153
21629992323,0cyclictest0-21swapper/310:18:053
21629992323,0cyclictest0-21swapper/309:12:473
21629992322,1cyclictest31308-21ssh10:21:033
21629992321,1cyclictest14585-21ssh11:02:043
2162999230,23cyclictest15811-21diskmemload09:31:533
2162999230,23cyclictest15811-21diskmemload09:24:173
2162999230,23cyclictest0-21swapper/311:44:383
2162999230,23cyclictest0-21swapper/311:18:063
2162999230,23cyclictest0-21swapper/310:29:023
2162999230,23cyclictest0-21swapper/310:01:293
2162999230,22cyclictest5112-21sh09:28:503
2162999230,22cyclictest26612-21ssh10:45:063
2162999230,22cyclictest22183-21ssh09:15:413
2162999230,0cyclictest15811-21diskmemload12:29:153
2162999230,0cyclictest15811-21diskmemload12:06:383
2162999230,0cyclictest15811-21diskmemload10:55:083
2162999230,0cyclictest15811-21diskmemload10:35:143
2162999230,0cyclictest0-21swapper/309:48:253
21624992323,0cyclictest19959-21ssh12:33:182
21624992323,0cyclictest0-21swapper/212:25:032
21624992323,0cyclictest0-21swapper/211:54:132
21624992323,0cyclictest0-21swapper/211:37:572
21624992322,1cyclictest30847-21ssh11:46:322
21624992322,1cyclictest24246-21df_inode11:11:472
21624992322,1cyclictest15811-21diskmemload11:00:122
2162499230,23cyclictest15811-21diskmemload10:06:122
2162499230,23cyclictest0-21swapper/212:02:002
2162499230,23cyclictest0-21swapper/211:31:182
2162499230,23cyclictest0-21swapper/211:22:382
2162499230,23cyclictest0-21swapper/210:58:052
2162499230,23cyclictest0-21swapper/209:55:232
2162499230,23cyclictest0-21swapper/209:26:522
2162499230,22cyclictest27268-21sh10:46:022
2162499230,22cyclictest21598-21ssh09:42:502
2162499230,22cyclictest19633-21ssh09:12:322
2162499230,22cyclictest12502-21ssh09:35:252
2162499230,1cyclictest14132-21apt-get08:01:442
2162499230,0cyclictest0-21swapper/212:22:552
2162499230,0cyclictest0-21swapper/212:06:332
2162499230,0cyclictest0-21swapper/210:24:342
21620992323,0cyclictest15811-21diskmemload09:40:301
21620992323,0cyclictest0-21swapper/111:37:181
21620992323,0cyclictest0-21swapper/110:16:421
21620992323,0cyclictest0-21swapper/109:26:141
21620992322,1cyclictest0-21swapper/109:55:501
21620992322,1cyclictest0-21swapper/109:36:021
21620992322,1cyclictest0-21swapper/109:17:001
21620992321,1cyclictest0-21swapper/112:05:471
21620992321,1cyclictest0-21swapper/111:55:371
21620992321,1cyclictest0-21swapper/111:30:311
21620992321,1cyclictest0-21swapper/109:52:021
21620992320,2cyclictest16557-21sh12:30:551
2162099230,2cyclictest8885-21sh10:57:001
2162099230,22cyclictest23469-21rm09:45:101
2162099230,22cyclictest15811-21diskmemload11:07:051
2162099230,22cyclictest11628-21kworker/u8:011:15:271
2162099230,22cyclictest10501-21sh10:31:001
2162099230,22cyclictest0-21swapper/111:50:391
2162099230,22cyclictest0-21swapper/111:40:481
2162099230,0cyclictest0-21swapper/112:35:031
2162099230,0cyclictest0-21swapper/111:46:101
2162099230,0cyclictest0-21swapper/111:20:281
2162099230,0cyclictest0-21swapper/110:13:501
21617992323,0cyclictest0-21swapper/011:35:130
21617992323,0cyclictest0-21swapper/011:25:100
21617992322,1cyclictest0-21swapper/008:36:440
21617992322,0cyclictest0-21swapper/010:10:550
21617992321,2cyclictest0-21swapper/011:17:020
21617992321,1cyclictest15846-21grep09:10:000
2161799231,22cyclictest13-21ksoftirqd/009:49:390
2161799230,23cyclictest0-21swapper/010:07:460
2161799230,22cyclictest6935-21sh09:30:260
2161799230,22cyclictest4911-21sh12:20:230
2161799230,22cyclictest3028-21sh09:56:160
2161799230,22cyclictest29487-21ssh12:13:120
2161799230,22cyclictest24612-21sh12:36:590
2161799230,22cyclictest19888-21sh10:38:540
2161799230,22cyclictest12238-21sh09:35:050
2161799230,22cyclictest11305-21cron07:55:010
2161799230,22cyclictest0-21swapper/009:19:250
2161799230,22cyclictest0-21swapper/009:10:020
2161799230,1cyclictest8035-21ssh11:54:330
2161799230,1cyclictest1914-21ssh09:55:000
2161799230,1cyclictest0-21swapper/012:04:550
2161799230,1cyclictest0-21swapper/011:00:060
2161799230,1cyclictest0-21swapper/010:55:370
2161799230,0cyclictest0-21swapper/011:23:130
2161799230,0cyclictest0-21swapper/009:26:420
21629992222,0cyclictest0-21swapper/312:35:033
21629992222,0cyclictest0-21swapper/311:57:253
21629992222,0cyclictest0-21swapper/311:46:103
21629992221,1cyclictest7246-21ssh09:59:413
2162999220,2cyclictest21409-21ssh10:40:453
2162999220,22cyclictest15811-21diskmemload12:13:053
2162999220,22cyclictest15811-21diskmemload12:00:313
2162999220,22cyclictest15811-21diskmemload09:43:583
2162999220,21cyclictest4681-21apt-get12:20:023
2162999220,21cyclictest3776-21apt-get08:46:443
2162999220,21cyclictest3141-21ssh11:50:123
2162999220,21cyclictest19189-21ssh11:36:323
2162999220,21cyclictest15848-21perf09:10:003
2162999220,21cyclictest12449-21ssh09:35:213
2162999220,0cyclictest15811-21diskmemload12:31:203
21624992222,0cyclictest0-21swapper/212:35:472
21624992222,0cyclictest0-21swapper/211:15:452
21624992222,0cyclictest0-21swapper/210:38:322
21624992221,1cyclictest4531-21apt-get07:41:452
21624992220,2cyclictest7405-21diskmemload11:25:452
21624992220,1cyclictest2141-21ntp_states10:51:512
21624992220,1cyclictest1229-21munin-run07:35:002
2162499220,22cyclictest0-21swapper/210:42:372
2162499220,21cyclictest4361-21ssh10:25:182
2162499220,21cyclictest25619-21memory09:46:512
2162499220,21cyclictest21719-21apt-get08:16:452
2162499220,21cyclictest10312-21ssh10:30:462
2162499220,21cyclictest0-21swapper/209:21:402
2162499220,0cyclictest0-21swapper/211:06:592
2162499220,0cyclictest0-21swapper/210:11:212
21620992221,1cyclictest5967-21apt-get09:30:021
21620992221,1cyclictest2732-21kworker/u8:210:01:441
21620992220,1cyclictest0-21swapper/112:20:151
21620992220,1cyclictest0-21swapper/112:10:301
2162099220,22cyclictest0-21swapper/110:29:311
2162099220,21cyclictest0-21swapper/110:50:341
2162099220,21cyclictest0-21swapper/109:20:171
2162099220,21cyclictest0-21swapper/108:45:011
2162099220,21cyclictest0-21swapper/108:06:441
2162099220,1cyclictest0-21swapper/112:26:061
21617992222,0cyclictest15811-21diskmemload10:41:140
21617992220,1cyclictest0-21swapper/007:46:440
2161799220,21cyclictest29179-21apt-get07:26:440
2161799220,21cyclictest24364-21apt-get07:16:440
2161799220,21cyclictest15811-21diskmemload10:31:020
2161799220,21cyclictest11045-21sendmail-msp09:00:000
2161799220,21cyclictest0-21swapper/011:11:330
2161799220,21cyclictest0-21swapper/010:45:350
2161799220,21cyclictest0-21swapper/009:20:030
2161799220,1cyclictest1216-21apt-get07:35:000
2161799220,0cyclictest0-21swapper/009:40:570
21629992121,0cyclictest0-21swapper/311:20:523
21629992120,1cyclictest0-21swapper/307:56:443
21629992119,1cyclictest11034-21apt09:00:003
21629992119,1cyclictest0-21swapper/307:20:003
2162999210,20cyclictest0-21swapper/308:16:453
2162999210,0cyclictest0-21swapper/308:51:553
21624992121,0cyclictest0-21swapper/208:31:442
21624992120,1cyclictest1370-21apt-get08:41:432
2162499210,21cyclictest22439-21ssh09:16:012
2162499210,21cyclictest0-21swapper/212:15:122
2162499210,21cyclictest0-21swapper/208:36:442
2162499210,0cyclictest26531-21apt-get08:26:452
21620992121,0cyclictest0-21swapper/108:01:441
21620992119,1cyclictest15826-21sh09:10:001
2162099210,21cyclictest0-21swapper/107:16:441
2162099210,20cyclictest6175-21apt-get08:51:451
2162099210,20cyclictest21969-21apt-get07:11:431
2162099210,20cyclictest0-21swapper/107:36:441
2162099210,20cyclictest0-21swapper/107:26:431
2162099210,0cyclictest0-21swapper/107:56:441
21617992120,1cyclictest0-21swapper/007:45:010
2161799210,21cyclictest18934-21perf08:10:000
2161799210,20cyclictest0-21swapper/008:11:430
21629992020,0cyclictest31379-21apt-get08:36:443
21629992020,0cyclictest16920-21apt-get08:06:443
2162999200,19cyclictest0-21swapper/307:36:443
2162999200,0cyclictest0-21swapper/307:46:443
21624992020,0cyclictest0-21swapper/208:51:452
21624992020,0cyclictest0-21swapper/207:26:432
21624992019,1cyclictest11315-21cron07:55:012
21624992018,1cyclictest11029-21perf09:00:002
2162499200,20cyclictest0-21swapper/208:06:442
21620992020,0cyclictest5787-21perf08:50:011
21620992020,0cyclictest0-21swapper/108:16:451
2162099200,0cyclictest0-21swapper/108:36:441
21617992020,0cyclictest0-21swapper/008:01:440
21629991919,0cyclictest0-21swapper/308:41:443
21629991919,0cyclictest0-21swapper/307:26:433
21629991919,0cyclictest0-21swapper/307:11:433
21624991919,0cyclictest0-21swapper/209:01:442
21624991919,0cyclictest0-21swapper/207:35:022
21624991919,0cyclictest0-21swapper/207:21:442
21624991917,1cyclictest15842-21turbostat09:10:002
21620991918,1cyclictest9320-21apt-get07:51:441
21620991918,1cyclictest0-21swapper/108:31:441
21617991919,0cyclictest24136-21apt-get08:21:440
21617991919,0cyclictest0-21swapper/008:51:450
21617991918,0cyclictest28550-21perf08:30:000
21617991917,1cyclictest3377-21awk08:45:010
21629991818,0cyclictest0-21swapper/308:01:443
21624991818,0cyclictest0-21swapper/207:16:442
21624991817,0cyclictest6924-21apt-get07:46:442
21617991818,0cyclictest0-21swapper/008:16:450
21624991717,0cyclictest0-21swapper/208:11:432
21620991714,2cyclictest8907-21cron07:50:011
21617991717,0cyclictest0-21swapper/007:36:440
21617991716,0cyclictest0-21swapper/008:00:010
21629991616,0cyclictest0-21swapper/308:31:443
2162099160,15cyclictest28796-21perf07:25:001
2162999155,10cyclictest783-21snmpd08:27:573
21629991515,0cyclictest0-21swapper/307:51:443
21629991513,1cyclictest28806-21munin-run07:25:003
21629991513,1cyclictest0-21swapper/308:11:463
2162499150,1cyclictest0-21swapper/208:46:482
21620991515,0cyclictest0-21swapper/108:26:451
21620991515,0cyclictest0-21swapper/107:41:451
2162099150,14cyclictest0-21swapper/108:11:461
2162999140,14cyclictest0-21swapper/309:01:583
2162999140,14cyclictest0-21swapper/308:20:313
2162999140,14cyclictest0-21swapper/307:40:043
2162999140,0cyclictest0-21swapper/307:30:383
2162499140,14cyclictest0-21swapper/207:55:242
2162499140,0cyclictest0-21swapper/208:20:192
2162499140,0cyclictest0-21swapper/207:10:412
21620991414,0cyclictest11430-21apt-get09:01:451
21620991414,0cyclictest0-21swapper/107:30:541
2162099140,0cyclictest0-21swapper/108:55:131
21617991414,0cyclictest0-21swapper/008:46:280
2161799140,14cyclictest0-21swapper/009:00:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional