You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 19:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Apr 16, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3160221200,5sleep01992499cyclictest09:38:020
19601211996,18sleep00-21swapper/007:06:100
19681211797,15sleep30-21swapper/307:07:133
19622211797,15sleep10-21swapper/107:06:271
19792211292,15sleep20-21swapper/207:08:402
153692850,1sleep00-21swapper/009:20:470
305392830,1sleep330535-21ssh11:51:023
121692810,5sleep01992499cyclictest10:25:120
243872740,0sleep10-21swapper/112:18:491
103202730,0sleep20-21swapper/210:56:052
320192710,0sleep30-21swapper/309:38:433
55292700,1sleep31992799cyclictest10:18:103
277952500,3sleep01992499cyclictest12:21:360
1992499250,23cyclictest0-21swapper/008:05:130
260482230,6sleep21992699cyclictest10:05:222
1992499230,18cyclictest0-21swapper/009:15:050
129782230,2sleep10-21swapper/108:10:161
1992699224,2cyclictest0-21swapper/209:20:052
1992499220,17cyclictest0-21swapper/012:17:040
19927992118,2cyclictest3506-21kworker/u8:011:07:043
19927992118,2cyclictest15788-21kworker/u8:208:29:053
19926992118,2cyclictest26210-21kworker/u8:108:00:052
1992499210,16cyclictest0-21swapper/007:39:040
183562210,0sleep30-21swapper/309:57:463
19927992017,2cyclictest9739-21kworker/u8:012:00:053
19927992017,2cyclictest9739-21kworker/u8:012:00:043
19927992017,2cyclictest9479-21kworker/u8:110:58:053
19927992017,2cyclictest8966-21kworker/u8:110:00:053
19927992017,2cyclictest8966-21kworker/u8:109:51:043
19927992017,2cyclictest8256-21kworker/u8:008:08:013
19927992017,2cyclictest8225-21kworker/u8:010:21:043
19927992017,2cyclictest25183-21kworker/u8:209:44:043
19927992017,2cyclictest25183-21kworker/u8:209:34:043
19927992017,2cyclictest22460-21kworker/u8:008:59:043
19927992017,2cyclictest22460-21kworker/u8:008:59:043
19927992017,2cyclictest21624-21kworker/u8:210:48:043
19927992017,2cyclictest17069-21kworker/u8:112:20:063
19927992017,2cyclictest17069-21kworker/u8:112:18:043
19927992017,2cyclictest16304-21kworker/u8:211:15:053
19927992017,2cyclictest15366-21kworker/u8:009:25:043
19927992017,2cyclictest15366-21kworker/u8:009:23:043
19927992017,2cyclictest12274-21kworker/u8:108:48:043
19926992017,2cyclictest9739-21kworker/u8:011:51:042
19926992017,2cyclictest8256-21kworker/u8:008:07:042
19925992017,2cyclictest12274-21kworker/u8:108:23:041
19927991916,2cyclictest9739-21kworker/u8:011:31:043
19927991916,2cyclictest8256-21kworker/u8:008:16:053
19927991916,2cyclictest5991-21kworker/u8:207:59:043
19927991916,2cyclictest3207-21kworker/u8:009:47:043
19927991916,2cyclictest31479-21kworker/u8:112:30:053
19927991916,2cyclictest29057-21kworker/u8:110:10:043
19927991916,2cyclictest27874-21kworker/u8:110:42:043
19927991916,2cyclictest23760-21kworker/u8:111:58:043
19927991916,2cyclictest22460-21kworker/u8:009:01:043
19927991916,2cyclictest20175-21kworker/u8:207:12:053
19927991916,2cyclictest18329-21kworker/u8:211:43:053
19927991916,2cyclictest18329-21kworker/u8:211:39:043
19927991916,2cyclictest14978-21kworker/u8:110:29:053
19927991916,2cyclictest12274-21kworker/u8:108:43:053
1992699192,2cyclictest0-21swapper/210:03:052
1992699190,2cyclictest0-21swapper/211:38:042
1992699190,2cyclictest0-21swapper/209:40:042
19925991916,2cyclictest9739-21kworker/u8:011:34:051
19925991916,2cyclictest8640-21kworker/u8:209:18:041
19925991916,2cyclictest30429-21kworker/u8:109:38:051
19925991916,2cyclictest23225-21kworker/u8:010:13:041
1992499190,18cyclictest0-21swapper/009:32:040
1992499190,18cyclictest0-21swapper/009:28:020
19927991815,2cyclictest9739-21kworker/u8:012:29:043
19927991815,2cyclictest9739-21kworker/u8:012:10:043
19927991815,2cyclictest23225-21kworker/u8:010:06:043
19927991815,2cyclictest22460-21kworker/u8:008:36:043
19927991815,2cyclictest16304-21kworker/u8:211:23:043
19927991815,2cyclictest12274-21kworker/u8:108:33:043
1992699180,2cyclictest0-21swapper/207:38:052
19925991815,2cyclictest27874-21kworker/u8:110:41:051
19925991815,2cyclictest25183-21kworker/u8:209:50:021
19925991815,2cyclictest2185-21kworker/u8:109:13:041
19925991815,2cyclictest2185-21kworker/u8:109:07:041
19925991815,2cyclictest21688-21kworker/u8:111:09:051
19925991815,2cyclictest20175-21kworker/u8:207:29:051
19925991815,2cyclictest14978-21kworker/u8:110:30:041
19925991815,2cyclictest12274-21kworker/u8:108:34:051
1992499180,2cyclictest0-21swapper/009:10:050
1992499180,17cyclictest0-21swapper/011:54:040
1992499180,17cyclictest0-21swapper/011:29:040
1992499180,17cyclictest0-21swapper/011:00:040
19927991714,2cyclictest9485-21kworker/u8:212:05:053
19927991714,2cyclictest9485-21kworker/u8:212:05:043
19927991714,2cyclictest2185-21kworker/u8:109:12:053
19927991714,2cyclictest21624-21kworker/u8:210:50:053
19927991714,2cyclictest21624-21kworker/u8:210:38:023
19927991714,2cyclictest20175-21kworker/u8:207:45:043
19927991714,2cyclictest20175-21kworker/u8:207:42:043
19927991714,2cyclictest20175-21kworker/u8:207:16:043
19927991714,2cyclictest16304-21kworker/u8:211:12:043
19927991714,2cyclictest15788-21kworker/u8:208:20:043
19926991714,2cyclictest20175-21kworker/u8:207:17:042
1992699171,2cyclictest0-21swapper/210:46:042
19925991714,2cyclictest8966-21kworker/u8:109:58:041
19925991714,2cyclictest3425-21kworker/u8:007:51:051
19925991714,2cyclictest31608-21kworker/u8:107:10:041
19925991714,2cyclictest29057-21kworker/u8:110:20:041
19925991714,2cyclictest2791-21kworker/u8:111:25:041
19925991714,2cyclictest2185-21kworker/u8:109:30:041
19925991714,2cyclictest21624-21kworker/u8:210:36:041
19925991714,2cyclictest18329-21kworker/u8:211:42:051
19925991714,2cyclictest12274-21kworker/u8:108:44:051
19924991714,2cyclictest3506-21kworker/u8:010:53:040
19924991714,2cyclictest29057-21kworker/u8:110:19:050
19924991714,2cyclictest23760-21kworker/u8:112:02:040
19924991714,2cyclictest23760-21kworker/u8:112:02:040
1992499170,16cyclictest0-21swapper/008:13:040
19927991613,2cyclictest26210-21kworker/u8:107:50:043
1992699163,2cyclictest0-21swapper/212:07:042
1992699163,2cyclictest0-21swapper/212:07:042
1992699160,2cyclictest0-21swapper/209:45:042
1992699160,2cyclictest0-21swapper/208:26:052
19925991613,2cyclictest9739-21kworker/u8:011:52:041
19925991613,2cyclictest9485-21kworker/u8:212:03:051
19925991613,2cyclictest9485-21kworker/u8:212:03:041
19925991613,2cyclictest8256-21kworker/u8:008:05:051
19925991613,2cyclictest8256-21kworker/u8:008:03:041
19925991613,2cyclictest5991-21kworker/u8:207:55:041
19925991613,2cyclictest29501-21kworker/u8:208:54:041
19925991613,2cyclictest29057-21kworker/u8:110:17:051
19925991613,2cyclictest26601-21kworker/u8:212:25:041
19925991613,2cyclictest25183-21kworker/u8:210:09:041
19925991613,2cyclictest2185-21kworker/u8:109:20:011
19925991613,2cyclictest15788-21kworker/u8:208:27:041
19925991613,2cyclictest11268-21kworker/u8:012:39:051
1992599160,14cyclictest0-21swapper/112:06:451
1992599160,14cyclictest0-21swapper/112:06:451
1992599160,14cyclictest0-21swapper/110:26:581
19924991613,2cyclictest8966-21kworker/u8:110:02:040
19924991613,2cyclictest8966-21kworker/u8:109:57:040
19924991613,2cyclictest12274-21kworker/u8:108:35:040
19927991512,2cyclictest22460-21kworker/u8:009:05:043
1992799150,13cyclictest0-21swapper/312:39:143
1992699151,13cyclictest20261-21ssh11:06:342
19926991511,3cyclictest13599-21diskstats11:00:142
19926991511,2cyclictest0-21swapper/208:10:142
19926991510,3cyclictest25593-21ssh11:12:242
1992699150,2cyclictest0-21swapper/211:19:052
1992699150,13cyclictest1962-21if_eth011:55:152
1992699150,13cyclictest0-21swapper/212:13:552
19925991512,2cyclictest9739-21kworker/u8:011:47:041
19925991512,2cyclictest22460-21kworker/u8:008:38:041
19925991512,2cyclictest12274-21kworker/u8:108:15:051
19925991510,2cyclictest0-21swapper/111:15:031
1992599150,13cyclictest585-21munin-node1
1992499150,14cyclictest0-21swapper/007:57:040
1992499150,14cyclictest0-21swapper/007:46:050
72622141,3sleep07375-21latency_hist12:35:000
1992799140,2cyclictest0-21swapper/311:05:003
1992799140,2cyclictest0-21swapper/310:33:043
19926991411,2cyclictest0-21swapper/212:31:252
19926991411,2cyclictest0-21swapper/212:21:062
19926991411,2cyclictest0-21swapper/210:20:442
1992699141,11cyclictest0-21swapper/209:35:582
1992699140,12cyclictest32328-21apt-get07:40:102
1992699140,12cyclictest31479-21kworker/u8:112:27:042
19925991411,2cyclictest5426-21copy09:45:041
19925991411,2cyclictest23760-21kworker/u8:111:57:051
19925991411,2cyclictest20175-21kworker/u8:207:37:041
19925991411,2cyclictest20175-21kworker/u8:207:30:041
19925991411,2cyclictest20175-21kworker/u8:207:20:041
1992599140,2cyclictest22869-21aten2.4_r3power11:10:131
1992599140,2cyclictest0-21swapper/110:51:181
1992599140,13cyclictest0-21swapper/111:00:481
1992599140,12cyclictest0-21swapper/110:46:031
19924991411,2cyclictest9485-21kworker/u8:212:07:040
19924991411,2cyclictest9485-21kworker/u8:212:07:040
19924991411,2cyclictest23225-21kworker/u8:010:12:010
19924991411,2cyclictest16102-21kworker/u8:007:22:040
19924991410,2cyclictest22622-21latency_hist11:10:010
1992499140,12cyclictest0-21swapper/007:15:120
102842140,2sleep00-21swapper/012:37:140
1992799130,2cyclictest0-21swapper/311:45:123
1992799130,2cyclictest0-21swapper/311:25:203
1992799130,2cyclictest0-21swapper/308:03:053
1992799130,12cyclictest0-21swapper/309:16:133
1992699131,10cyclictest22780-21ssh12:16:172
19926991310,2cyclictest0-21swapper/211:26:242
19926991310,2cyclictest0-21swapper/209:30:152
1992699130,12cyclictest0-21swapper/211:22:352
1992699130,12cyclictest0-21swapper/209:59:142
1992699130,12cyclictest0-21swapper/209:27:152
1992699130,12cyclictest0-21swapper/209:13:152
1992699130,11cyclictest3878-21diskmemload09:15:572
1992699130,11cyclictest0-21swapper/210:51:262
19925991310,2cyclictest3878-21diskmemload11:35:351
19925991310,2cyclictest0-21swapper/112:14:121
19925991310,2cyclictest0-21swapper/109:40:021
19925991310,2cyclictest0-21swapper/109:27:571
1992599130,2cyclictest0-21swapper/110:58:581
1992599130,2cyclictest0-21swapper/110:02:491
1992599130,2cyclictest0-21swapper/109:00:091
1992499131,2cyclictest14696-21diskstats08:15:140
19924991310,2cyclictest9739-21kworker/u8:011:40:040
19924991310,2cyclictest3878-21diskmemload12:10:430
19924991310,2cyclictest3878-21diskmemload11:55:210
19924991310,2cyclictest25183-21kworker/u8:209:54:050
19924991310,2cyclictest25183-21kworker/u8:209:40:050
19924991310,2cyclictest20355-21apt-get08:30:120
19924991310,2cyclictest15788-21kworker/u8:208:26:040
19924991310,2cyclictest12274-21kworker/u8:108:49:040
19924991310,2cyclictest0-21swapper/012:29:500
19924991310,2cyclictest0-21swapper/011:35:300
19924991310,2cyclictest0-21swapper/011:15:010
19924991310,2cyclictest0-21swapper/011:12:380
19924991310,2cyclictest0-21swapper/010:43:500
19924991310,2cyclictest0-21swapper/010:30:210
19924991310,2cyclictest0-21swapper/008:55:110
19924991310,2cyclictest0-21swapper/008:55:100
1992499130,2cyclictest0-21swapper/010:45:170
1992499130,12cyclictest0-21swapper/011:21:120
1992799120,2cyclictest0-21swapper/308:53:053
1992799120,10cyclictest0-21swapper/307:37:053
1992699129,2cyclictest0-21swapper/211:40:182
1992699126,4cyclictest4562-21gdm-simple-gree08:34:582
1992699121,2cyclictest0-21swapper/210:37:042
1992699120,2cyclictest0-21swapper/212:01:382
1992699120,2cyclictest0-21swapper/212:01:372
1992699120,11cyclictest0-21swapper/212:35:172
1992699120,11cyclictest0-21swapper/211:32:062
1992699120,11cyclictest0-21swapper/210:40:062
1992699120,11cyclictest0-21swapper/210:25:472
1992699120,11cyclictest0-21swapper/210:13:362
1992699120,11cyclictest0-21swapper/208:50:052
1992699120,10cyclictest0-21swapper/207:45:102
1992599129,2cyclictest26210-21kworker/u8:107:49:041
1992599129,2cyclictest0-21swapper/112:30:291
1992599120,11cyclictest0-21swapper/112:21:181
1992499129,2cyclictest22460-21kworker/u8:009:02:050
1992499129,2cyclictest2185-21kworker/u8:109:08:040
1992499129,2cyclictest0-21swapper/010:23:200
1992499120,2cyclictest0-21swapper/011:46:120
1992499120,2cyclictest0-21swapper/011:30:070
1992499120,2cyclictest0-21swapper/008:50:150
1992499120,11cyclictest0-21swapper/010:57:380
1992499120,11cyclictest0-21swapper/010:36:390
1992499120,11cyclictest0-21swapper/010:05:050
1992499120,11cyclictest0-21swapper/009:46:120
1992799110,2cyclictest0-21swapper/307:30:043
1992699118,2cyclictest0-21swapper/210:16:382
1992699118,2cyclictest0-21swapper/209:52:152
1992699112,7cyclictest0-21swapper/207:58:582
1992699110,2cyclictest0-21swapper/210:31:362
1992599110,9cyclictest30436-21munin-node1
1992599110,9cyclictest30436-21munin-node1
1992499118,2cyclictest0-21swapper/008:05:000
1992499110,2cyclictest0-21swapper/007:25:010
1992499110,10cyclictest0-21swapper/007:14:000
37182100,2sleep20-21swapper/209:08:112
1992699105,3cyclictest27032-21wc08:45:162
1992699105,3cyclictest1802-21munin-plugin-st09:05:012
1992699102,6cyclictest0-21swapper/207:25:022
1992699101,7cyclictest24123-21ssh11:45:122
1992699100,2cyclictest0-21swapper/207:53:052
1992599107,2cyclictest0-21swapper/107:15:121
1992599100,8cyclictest0-21swapper/108:45:131
1992599100,8cyclictest0-21swapper/107:40:111
1992499107,2cyclictest20175-21kworker/u8:207:41:050
1992499107,2cyclictest0-21swapper/007:50:160
199269995,2cyclictest29-21rcuc/208:20:122
199269994,3cyclictest28368-21aten2.4_r3power07:30:112
199269994,3cyclictest274-21jbd2/sda1-807:22:262
199269994,3cyclictest24511-21tail08:40:122
199269994,3cyclictest20453-21df_abs07:10:122
199269994,3cyclictest14084-21latency_hist08:15:012
199269992,5cyclictest0-21swapper/208:57:582
199269992,5cyclictest0-21swapper/208:57:582
199269990,7cyclictest0-21swapper/208:35:012
199249996,2cyclictest0-21swapper/008:40:130
199249992,6cyclictest0-21swapper/007:32:370
13364290,6sleep30-21swapper/308:10:593
199279983,3cyclictest277892chrt07:27:203
199279980,3cyclictest2394350apt-get07:20:063
199249985,2cyclictest16974-21modprobe08:20:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional