You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 01:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed May 13, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24668211999,15sleep00-21swapper/007:09:350
24571211797,15sleep30-21swapper/307:08:213
24410211799,13sleep20-21swapper/207:06:162
23965211794,16sleep10-21swapper/107:05:431
136012770,1sleep20-21swapper/212:09:322
7432710,1sleep229-21rcuc/208:50:122
55082690,0sleep30-21swapper/310:50:133
126222690,0sleep30-21swapper/310:57:553
65242660,0sleep00-21swapper/011:25:490
266002650,0sleep20-21swapper/210:38:052
269312290,1sleep20-21swapper/209:29:192
33442220,0sleep20-21swapper/210:47:482
24732992217,3cyclictest26666-21kworker/u8:112:26:043
24731992218,2cyclictest0-21swapper/208:45:122
24731992218,2cyclictest0-21swapper/208:45:112
24732992118,2cyclictest31245-21kworker/u8:209:22:043
24732992118,2cyclictest17514-21kworker/u8:009:54:053
2473199210,16cyclictest0-21swapper/211:00:042
24732992017,2cyclictest9405-21kworker/u8:110:30:043
24732992017,2cyclictest26666-21kworker/u8:112:24:043
24731992017,2cyclictest21107-21kworker/u8:208:36:042
24731992017,2cyclictest2053-21kworker/u8:107:59:042
2472999200,2cyclictest0-21swapper/007:15:110
2472999200,19cyclictest0-21swapper/008:55:100
325142190,0sleep30-21swapper/310:45:003
24731991916,2cyclictest7588-21kworker/u8:211:33:042
24731991916,2cyclictest7588-21kworker/u8:211:33:042
24731991916,2cyclictest3189-21kworker/u8:010:18:042
24731991916,2cyclictest29702-21kworker/u8:011:22:042
24731991916,2cyclictest29702-21kworker/u8:010:43:042
24731991916,2cyclictest27219-21kworker/u8:111:51:042
24731991916,2cyclictest18320-21kworker/u8:109:20:042
24731991916,2cyclictest16597-21kworker/u8:008:11:042
24731991916,2cyclictest16597-21kworker/u8:008:09:042
2472999190,2cyclictest0-21swapper/008:50:120
170672190,1sleep2301ktimersoftd/211:37:222
170672190,1sleep2301ktimersoftd/211:37:222
24732991815,2cyclictest7997-21kworker/u8:109:12:043
24732991815,2cyclictest32685-21kworker/u8:012:13:043
24732991815,2cyclictest29702-21kworker/u8:011:16:043
24732991815,2cyclictest17492-21kworker/u8:111:06:043
24731991815,2cyclictest9753-21kworker/u8:210:56:042
24731991815,2cyclictest9405-21kworker/u8:110:22:042
24731991815,2cyclictest9376-21kworker/u8:210:04:052
24731991815,2cyclictest4345-21kworker/u8:007:39:052
24731991815,2cyclictest22481-21kworker/u8:211:14:042
24731991815,2cyclictest21107-21kworker/u8:208:31:042
24731991815,2cyclictest18685-21kworker/u8:108:42:042
24731991815,2cyclictest18685-21kworker/u8:108:20:042
24731991815,2cyclictest1671-21kworker/u8:111:26:012
2473199180,13cyclictest0-21swapper/209:09:042
24732991714,2cyclictest9376-21kworker/u8:210:11:043
24732991714,2cyclictest9376-21kworker/u8:209:48:043
24732991714,2cyclictest5163-21kworker/u8:212:08:063
24732991714,2cyclictest3737-21kworker/u8:109:41:043
24732991714,2cyclictest372-21kworker/u8:012:38:043
24732991714,2cyclictest12810-21kworker/u8:009:19:043
24732991713,2cyclictest17514-21kworker/u8:010:05:043
24731991714,2cyclictest9376-21kworker/u8:210:12:012
24731991714,2cyclictest32685-21kworker/u8:011:56:042
24731991714,2cyclictest29702-21kworker/u8:011:46:042
24731991714,2cyclictest28458-21kworker/u8:007:27:042
24731991714,2cyclictest24947-21kworker/u8:309:32:042
24731991714,2cyclictest24941-21kworker/u8:107:14:052
24731991714,2cyclictest24207-21kworker/u8:009:42:042
24731991714,2cyclictest18887-21kworker/u8:212:35:042
24731991714,2cyclictest18685-21kworker/u8:108:25:052
24731991713,2cyclictest32258-21ssh09:35:132
2473199170,15cyclictest0-21swapper/212:02:042
24732991613,2cyclictest9405-21kworker/u8:110:25:043
24732991613,2cyclictest7588-21kworker/u8:211:41:043
24732991613,2cyclictest2488-21kworker/u8:110:47:043
24732991611,3cyclictest24359-21awk10:35:163
24732991611,3cyclictest0-21swapper/307:40:173
2473299160,2cyclictest8773-21diskmemload10:16:043
24731991613,2cyclictest29702-21kworker/u8:011:43:042
24731991613,2cyclictest29702-21kworker/u8:011:18:052
24731991613,2cyclictest28458-21kworker/u8:007:31:042
24731991613,2cyclictest26666-21kworker/u8:112:23:042
24731991613,2cyclictest13294-21kworker/u8:112:15:042
2473199160,11cyclictest0-21swapper/207:16:042
2473099160,3cyclictest0-21swapper/111:20:121
204582160,0sleep00-21swapper/010:31:020
24732991512,2cyclictest9405-21kworker/u8:110:20:043
24732991512,2cyclictest9376-21kworker/u8:209:59:043
24732991512,2cyclictest7588-21kworker/u8:211:32:043
24732991512,2cyclictest7588-21kworker/u8:211:32:043
24732991512,2cyclictest5129-21kworker/u8:009:01:043
24732991512,2cyclictest1671-21kworker/u8:111:23:043
24732991511,2cyclictest25365-21unixbench_singl11:11:053
24731991512,2cyclictest7997-21kworker/u8:109:11:052
24731991510,3cyclictest21843-21ssh09:58:222
24731991510,3cyclictest0-21swapper/212:30:162
2473199150,13cyclictest0-21swapper/210:52:062
24730991512,2cyclictest8773-21diskmemload12:38:031
24730991510,3cyclictest0-21swapper/111:50:131
2473099150,13cyclictest0-21swapper/111:00:321
2472999150,13cyclictest19122-21tr12:15:120
2473299149,2cyclictest9376-21kworker/u8:210:00:053
24732991411,2cyclictest372-21kworker/u8:012:34:063
24732991411,2cyclictest31245-21kworker/u8:209:07:043
24732991411,2cyclictest28458-21kworker/u8:007:19:043
24732991411,2cyclictest27219-21kworker/u8:112:00:013
24732991411,2cyclictest24947-21kworker/u8:309:30:053
24732991411,2cyclictest21107-21kworker/u8:208:33:043
24732991411,2cyclictest18685-21kworker/u8:108:27:043
24732991411,2cyclictest16597-21kworker/u8:008:14:043
24732991411,2cyclictest0-21swapper/311:53:453
24732991411,2cyclictest0-21swapper/311:47:353
24732991411,2cyclictest0-21swapper/311:01:353
2473299141,11cyclictest8773-21diskmemload11:28:363
2473299140,2cyclictest0-21swapper/309:26:353
24731991411,2cyclictest0-21swapper/212:14:322
2473199140,13cyclictest0-21swapper/209:52:042
2473199140,12cyclictest16533-21taskset10:27:002
24730991411,2cyclictest0-21swapper/112:09:431
24730991411,2cyclictest0-21swapper/111:35:531
24730991411,2cyclictest0-21swapper/111:35:531
24730991411,2cyclictest0-21swapper/111:27:531
2473099140,2cyclictest0-21swapper/110:18:221
2473099140,13cyclictest0-21swapper/110:42:121
2473099140,13cyclictest0-21swapper/108:31:021
2473099140,13cyclictest0-21swapper/108:21:021
2473099140,12cyclictest0-21swapper/112:13:301
2473099140,12cyclictest0-21swapper/110:07:421
2473099140,12cyclictest0-21swapper/109:44:421
2472999142,10cyclictest3649-21snmpd10:14:580
24729991411,2cyclictest31549-21ssh10:09:020
24729991411,2cyclictest0-21swapper/010:42:540
24729991411,2cyclictest0-21swapper/007:30:120
2472999141,11cyclictest17040-21apt-get08:10:110
24729991410,2cyclictest28554-21cat09:30:160
2472999140,3cyclictest831-21fschecks_time11:20:140
2472999140,2cyclictest0-21swapper/008:21:020
2472999140,12cyclictest27136-21ssh11:48:480
2472999140,12cyclictest0-21swapper/010:58:430
24732991310,2cyclictest6713-21kworker/u8:208:03:043
24732991310,2cyclictest6713-21kworker/u8:207:50:043
24732991310,2cyclictest4345-21kworker/u8:007:38:043
24732991310,2cyclictest31026-21kworker/u8:207:29:043
24732991310,2cyclictest29702-21kworker/u8:011:37:043
24732991310,2cyclictest29702-21kworker/u8:011:37:043
24732991310,2cyclictest21107-21kworker/u8:208:35:043
24732991310,2cyclictest18685-21kworker/u8:108:49:043
24732991310,2cyclictest18685-21kworker/u8:108:49:043
24732991310,2cyclictest18685-21kworker/u8:108:41:043
24732991310,2cyclictest18685-21kworker/u8:108:24:043
24732991310,2cyclictest16597-21kworker/u8:008:15:043
24732991310,2cyclictest16597-21kworker/u8:008:08:013
24732991310,2cyclictest0-21swapper/309:36:073
2473299130,2cyclictest0-21swapper/307:30:143
2473299130,11cyclictest0-21swapper/311:56:053
2473199131,10cyclictest32147-21munin-run10:10:002
24731991310,2cyclictest0-21swapper/207:46:022
24731991310,2cyclictest0-21swapper/207:41:012
2473199130,2cyclictest0-21swapper/208:01:052
2473099139,2cyclictest24017-21sh09:25:171
2473099138,3cyclictest0-21swapper/108:55:131
2473099131,10cyclictest13600-21latency_hist09:49:591
24730991310,2cyclictest0-21swapper/112:34:131
24730991310,2cyclictest0-21swapper/111:06:421
24730991310,2cyclictest0-21swapper/110:35:341
24730991310,2cyclictest0-21swapper/109:35:031
24730991310,2cyclictest0-21swapper/109:20:221
2473099130,3cyclictest0-21swapper/112:25:181
2473099130,2cyclictest0-21swapper/111:46:231
2473099130,2cyclictest0-21swapper/110:24:321
2473099130,12cyclictest0-21swapper/112:20:441
2473099130,12cyclictest0-21swapper/111:56:331
2473099130,12cyclictest0-21swapper/111:13:321
2473099130,11cyclictest0-21swapper/110:50:281
2473099130,11cyclictest0-21swapper/109:10:291
2472999138,3cyclictest4743-21turbostat07:40:000
24729991310,2cyclictest0-21swapper/010:21:020
2472999130,8cyclictest0-21swapper/010:51:040
2472999130,2cyclictest0-21swapper/009:25:110
2472999130,12cyclictest0-21swapper/008:16:030
2473299129,2cyclictest6713-21kworker/u8:207:55:043
2473299129,2cyclictest31245-21kworker/u8:208:51:043
2473299129,2cyclictest0-21swapper/307:45:593
2473299122,7cyclictest0-21swapper/307:13:013
2473199129,2cyclictest0-21swapper/211:07:282
2473199129,2cyclictest0-21swapper/210:31:032
2473199129,2cyclictest0-21swapper/209:46:222
2473199121,8cyclictest4562-21gdm-simple-gree08:57:582
2473199120,2cyclictest0-21swapper/209:15:042
2473199120,2cyclictest0-21swapper/209:01:012
2473199120,2cyclictest0-21swapper/208:15:162
2473199120,1cyclictest0-21swapper/207:20:132
2473199120,11cyclictest0-21swapper/212:26:062
2473099129,2cyclictest0-21swapper/112:01:331
2473099129,2cyclictest0-21swapper/110:30:121
2473099128,2cyclictest0-21swapper/109:05:121
2473099127,3cyclictest19183-21cpuspeed_turbos11:40:121
2473099127,3cyclictest0-21swapper/110:55:131
2473099127,3cyclictest0-21swapper/107:50:131
2473099127,3cyclictest0-21swapper/107:25:151
2473099122,3cyclictest15669-21unixbench_singl09:16:031
2473099121,9cyclictest4705-21apt-get09:00:061
2473099121,9cyclictest17037-21munin-node1
2473099121,9cyclictest0-21swapper/107:45:121
2473099121,3cyclictest27671-21munin-node1
2473099120,3cyclictest25060-21unixbench_singl10:01:031
2473099120,3cyclictest19861-21missed_timers08:15:161
2473099120,3cyclictest0-21swapper/108:41:021
2473099120,2cyclictest0-21swapper/112:16:021
2473099120,2cyclictest0-21swapper/109:55:191
2473099120,11cyclictest0-21swapper/111:31:431
2473099120,11cyclictest0-21swapper/111:31:431
2473099120,11cyclictest0-21swapper/110:47:441
2473099120,11cyclictest0-21swapper/110:29:441
2473099120,11cyclictest0-21swapper/110:10:031
2473099120,10cyclictest0-21swapper/107:15:501
2472999129,2cyclictest0-21swapper/010:16:030
2472999129,2cyclictest0-21swapper/008:05:160
2472999129,2cyclictest0-21swapper/007:45:100
2472999122,7cyclictest0-21swapper/008:46:580
2472999122,7cyclictest0-21swapper/008:46:580
2472999122,7cyclictest0-21swapper/008:33:580
2472999120,2cyclictest0-21swapper/012:06:020
2472999120,2cyclictest0-21swapper/011:50:570
2472999120,2cyclictest0-21swapper/009:51:460
2472999120,2cyclictest0-21swapper/009:21:150
2472999120,2cyclictest0-21swapper/007:55:150
2472999120,11cyclictest23903-21ssh11:10:160
2472999120,11cyclictest0-21swapper/012:25:170
2472999120,11cyclictest0-21swapper/012:10:170
2472999120,11cyclictest0-21swapper/010:45:050
2472999120,11cyclictest0-21swapper/010:29:110
2472999120,11cyclictest0-21swapper/009:48:370
2472999120,11cyclictest0-21swapper/009:38:050
2472999120,11cyclictest0-21swapper/009:10:110
2472999120,11cyclictest0-21swapper/008:35:160
2472999120,11cyclictest0-21swapper/007:50:140
2472999120,10cyclictest29200-21ssh11:15:230
209692120,2sleep320979-21ssh12:16:243
2473099117,2cyclictest0-21swapper/107:30:141
2473099111,8cyclictest29909-21sed11:16:021
2473099111,8cyclictest1309-21smartctl08:50:151
2473099111,3cyclictest25340-21diskstats07:10:141
2473099110,9cyclictest0-21swapper/108:45:151
2473099110,9cyclictest0-21swapper/108:45:151
2473099110,9cyclictest0-21swapper/108:35:121
2473099110,3cyclictest0-21swapper/109:50:161
2472999118,2cyclictest0-21swapper/012:22:030
2472999118,2cyclictest0-21swapper/012:02:540
2472999118,2cyclictest0-21swapper/011:56:010
2472999112,6cyclictest0-21swapper/010:35:590
2472999112,6cyclictest0-21swapper/009:04:020
2472999112,6cyclictest0-21swapper/007:10:010
2472999110,9cyclictest11128-21ssh11:30:540
2472999110,9cyclictest11128-21ssh11:30:530
2472999110,2cyclictest0-21swapper/011:40:290
2472999110,2cyclictest0-21swapper/011:35:430
2472999110,2cyclictest0-21swapper/011:35:430
2472999110,2cyclictest0-21swapper/011:05:170
2472999110,10cyclictest0-21swapper/012:35:590
2472999110,10cyclictest0-21swapper/012:31:500
2472999110,10cyclictest0-21swapper/010:00:510
2472999110,10cyclictest0-21swapper/009:42:090
2472999110,10cyclictest0-21swapper/009:15:160
158602110,1sleep121-21rcuc/108:05:161
2473299106,2cyclictest29586-21hwlatdetect07:20:153
2473299104,4cyclictest4253-21grep08:56:033
2473199107,2cyclictest0-21swapper/207:50:122
2473099101,3cyclictest0-21swapper/107:35:151
2473099100,8cyclictest24067-21ps08:25:181
2473099100,8cyclictest0-21swapper/107:55:111
2473099100,8cyclictest0-21swapper/107:40:121
2473099100,8cyclictest0-21swapper/107:20:181
2473099100,3cyclictest0-21swapper/108:00:151
2472999107,2cyclictest0-21swapper/008:40:330
2472999107,2cyclictest0-21swapper/008:25:160
2472999107,2cyclictest0-21swapper/007:40:150
2472999102,7cyclictest0-21swapper/009:07:580
2472999102,7cyclictest0-21swapper/007:22:580
2472999102,6cyclictest0-21swapper/007:28:350
2472999102,5cyclictest0-21swapper/008:01:010
2472999100,7cyclictest0-21swapper/009:55:010
2472999100,2cyclictest0-21swapper/011:01:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional