You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 05:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat May 23, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8156211897,14sleep10-21swapper/119:06:001
8726210986,18sleep30-21swapper/319:08:153
8825210797,6sleep00-21swapper/019:09:320
8152210278,6sleep20-21swapper/219:05:572
284652720,0sleep00-21swapper/021:45:330
10672690,0sleep30-21swapper/320:06:033
19232490,1sleep31924-21munin-node3
8889994220,20cyclictest29-21rcuc/221:30:122
141472290,0sleep30-21swapper/322:38:233
227482250,0sleep00-21swapper/023:20:330
166722250,0sleep00-21swapper/022:06:540
151192240,1sleep00-21swapper/021:31:350
71042230,0sleep00-21swapper/021:24:050
888999221,19cyclictest18966-21ssh22:10:112
23712220,1sleep10-21swapper/120:10:141
888999210,19cyclictest0-21swapper/223:00:112
888999210,16cyclictest0-21swapper/219:58:012
279632210,0sleep20-21swapper/222:19:272
889099200,18cyclictest0-21swapper/323:05:113
889099200,18cyclictest0-21swapper/300:35:093
8889991916,2cyclictest4595-21kworker/u8:222:27:032
8889991916,2cyclictest13585-21kworker/u8:220:48:012
8889991916,2cyclictest1328-21kworker/u8:220:29:042
889099181,15cyclictest32124-21wc20:05:003
888999182,2cyclictest0-21swapper/200:30:052
8889991815,2cyclictest9234-21kworker/u8:119:20:032
8889991815,2cyclictest31183-21kworker/u8:123:34:042
8889991815,2cyclictest30469-21kworker/u8:121:58:042
8889991815,2cyclictest21344-21kworker/u8:020:02:012
8889991815,2cyclictest21344-21kworker/u8:019:47:042
8889991815,2cyclictest20363-21kworker/u8:021:07:042
8889991815,2cyclictest16797-21kworker/u8:219:37:042
8889991815,2cyclictest13585-21kworker/u8:221:02:042
8889991815,2cyclictest13585-21kworker/u8:220:44:012
8889991815,2cyclictest1328-21kworker/u8:220:20:042
8889991815,2cyclictest1328-21kworker/u8:220:09:042
888799180,2cyclictest0-21swapper/023:55:090
194542180,0sleep30-21swapper/322:10:143
889099171,3cyclictest25551-21munin-run21:10:003
888999172,2cyclictest0-21swapper/200:08:042
8889991714,2cyclictest5239-21kworker/u8:022:41:042
8889991714,2cyclictest21344-21kworker/u8:019:50:042
8889991714,2cyclictest10095-21kworker/u8:020:34:042
888999171,2cyclictest0-21swapper/222:47:042
888999171,2cyclictest0-21swapper/221:27:042
888999170,2cyclictest0-21swapper/219:15:042
888999170,12cyclictest0-21swapper/200:01:042
888999170,12cyclictest0-21swapper/200:01:042
8887991712,3cyclictest0-21swapper/021:50:170
888799170,15cyclictest0-21swapper/023:47:170
889099161,3cyclictest0-21swapper/321:53:453
889099161,3cyclictest0-21swapper/319:35:143
889099160,14cyclictest25514-21ssh22:50:133
889099160,14cyclictest0-21swapper/323:51:413
8889991613,2cyclictest16666-21kworker/u8:222:55:042
888999161,2cyclictest0-21swapper/223:40:042
888999160,15cyclictest0-21swapper/223:38:012
888999160,14cyclictest0-21swapper/221:42:052
888799161,3cyclictest0-21swapper/022:10:140
8887991611,3cyclictest3472-21ssh23:35:090
888799161,13cyclictest25545-21diskmemload22:36:270
888799161,13cyclictest24355-21users21:41:010
8890991512,2cyclictest22453-21kworker/u8:221:47:043
8890991511,2cyclictest22434-21ssh21:40:093
889099150,3cyclictest22003-21sed22:46:013
889099150,3cyclictest14414-21ssh00:20:133
888999151,12cyclictest30748-21aten2.4-expect21:15:122
888999150,2cyclictest0-21swapper/223:50:042
888999150,2cyclictest0-21swapper/222:53:032
888999150,10cyclictest0-21swapper/222:36:042
8887991511,3cyclictest8958-21turbostat00:19:550
888799151,12cyclictest6133-21munin-node0
8887991510,3cyclictest17947-21ssh23:15:320
84152151,3sleep34443-21packagekitd21:59:043
889099149,3cyclictest24985-21ssh22:15:283
889099149,3cyclictest0-21swapper/319:50:003
8890991411,2cyclictest20363-21kworker/u8:021:11:033
8890991411,2cyclictest0-21swapper/323:22:013
8890991411,2cyclictest0-21swapper/322:42:513
8890991411,2cyclictest0-21swapper/322:31:413
889099140,3cyclictest4892-21switchtime21:21:033
889099140,3cyclictest3649-21snmpd00:11:153
889099140,13cyclictest0-21swapper/323:17:313
889099140,13cyclictest0-21swapper/322:06:013
889099140,13cyclictest0-21swapper/322:03:503
889099140,13cyclictest0-21swapper/321:35:093
889099140,13cyclictest0-21swapper/300:04:213
889099140,13cyclictest0-21swapper/300:04:213
889099140,12cyclictest25545-21diskmemload22:24:223
889099140,12cyclictest0-21swapper/320:16:013
888999143,6cyclictest0-21swapper/221:50:002
888999142,7cyclictest0-21swapper/220:50:012
888999142,6cyclictest0-21swapper/222:35:002
888999140,3cyclictest17003-21munin-run19:30:002
888999140,2cyclictest0-21swapper/223:45:042
888999140,2cyclictest0-21swapper/223:09:042
888999140,2cyclictest0-21swapper/220:35:042
888999140,2cyclictest0-21swapper/220:15:042
888999140,2cyclictest0-21swapper/220:11:042
888999140,2cyclictest0-21swapper/219:32:042
888999140,2cyclictest0-21swapper/200:23:042
888999140,13cyclictest0-21swapper/223:28:052
888999140,12cyclictest0-21swapper/221:11:022
888799149,3cyclictest0-21swapper/020:00:140
888799141,12cyclictest25545-21diskmemload22:27:470
8887991411,2cyclictest0-21swapper/023:14:070
8887991411,2cyclictest0-21swapper/022:40:560
888799140,3cyclictest3728-21runrttasks23:42:380
888799140,3cyclictest20721-21cut20:55:180
888799140,3cyclictest18383-21munin-node0
888799140,12cyclictest15332-21ssh00:20:360
888799140,12cyclictest0-21swapper/022:31:370
268012140,2sleep00-21swapper/022:17:370
108772140,3sleep10-21swapper/122:00:591
889099132,6cyclictest0-21swapper/319:55:003
8890991310,2cyclictest0-21swapper/323:45:213
8890991310,2cyclictest0-21swapper/323:30:143
8890991310,2cyclictest0-21swapper/322:27:533
8890991310,2cyclictest0-21swapper/321:25:463
8890991310,2cyclictest0-21swapper/321:19:253
8890991310,2cyclictest0-21swapper/320:30:143
8890991310,2cyclictest0-21swapper/300:09:063
889099130,2cyclictest32687-21ssh22:57:253
889099130,2cyclictest0-21swapper/321:34:353
889099130,2cyclictest0-21swapper/320:25:183
889099130,1cyclictest0-21swapper/323:41:113
889099130,12cyclictest28446-21ssh23:26:213
889099130,12cyclictest0-21swapper/323:13:113
889099130,12cyclictest0-21swapper/319:40:503
889099130,11cyclictest25545-21diskmemload00:17:023
888999132,6cyclictest0-21swapper/200:00:012
888999131,10cyclictest21987-21ssh21:39:512
8889991310,2cyclictest9234-21kworker/u8:119:12:052
888999130,2cyclictest0-21swapper/220:59:042
888999130,2cyclictest0-21swapper/219:43:042
888899139,2cyclictest0-21swapper/121:55:151
888899139,2cyclictest0-21swapper/120:00:291
888899139,2cyclictest0-21swapper/119:50:111
888899138,3cyclictest0-21swapper/123:00:141
888899131,3cyclictest0-21swapper/120:46:001
8888991310,2cyclictest0-21swapper/122:57:021
8888991310,2cyclictest0-21swapper/122:30:141
888899130,2cyclictest0-21swapper/120:30:391
888899130,2cyclictest0-21swapper/119:10:301
888899130,11cyclictest0-21swapper/122:20:301
888899130,11cyclictest0-21swapper/100:25:171
888799139,2cyclictest0-21swapper/000:30:070
888799138,3cyclictest0-21swapper/019:30:500
888799132,6cyclictest0-21swapper/020:20:000
888799132,6cyclictest0-21swapper/019:50:000
8887991310,2cyclictest0-21swapper/023:02:070
8887991310,2cyclictest0-21swapper/021:57:080
8887991310,2cyclictest0-21swapper/021:05:150
8887991310,2cyclictest0-21swapper/000:14:570
8887991310,2cyclictest0-21swapper/000:05:370
888799130,2cyclictest29762-21ssh00:35:400
888799130,2cyclictest0-21swapper/023:30:120
888799130,2cyclictest0-21swapper/022:50:000
888799130,2cyclictest0-21swapper/022:24:390
888799130,2cyclictest0-21swapper/021:37:180
888799130,2cyclictest0-21swapper/019:10:140
888799130,12cyclictest0-21swapper/022:52:070
888799130,12cyclictest0-21swapper/021:00:170
888799130,12cyclictest0-21swapper/019:25:280
888799130,11cyclictest32718-21ssh21:16:110
888799130,11cyclictest25545-21diskmemload21:13:100
888799130,11cyclictest0-21swapper/000:25:430
311872130,1sleep2301ktimersoftd/222:22:032
889099129,2cyclictest0-21swapper/321:01:013
889099129,2cyclictest0-21swapper/319:20:133
889099129,2cyclictest0-21swapper/300:30:563
889099129,2cyclictest0-21swapper/300:25:263
889099127,3cyclictest16495-21diskstats20:45:123
889099122,7cyclictest0-21swapper/319:29:593
889099121,6cyclictest0-21swapper/319:20:003
889099120,1cyclictest0-21swapper/323:04:213
889099120,11cyclictest0-21swapper/323:56:253
889099120,11cyclictest0-21swapper/323:35:163
889099120,11cyclictest0-21swapper/320:36:013
888999127,3cyclictest0-21swapper/223:16:442
888999120,2cyclictest0-21swapper/223:20:042
888999120,2cyclictest0-21swapper/221:50:112
888999120,11cyclictest0-21swapper/221:21:032
888999120,10cyclictest13765-21sendmail-msp00:20:002
888999120,10cyclictest0-21swapper/222:04:012
888899129,2cyclictest0-21swapper/123:25:541
888899128,2cyclictest17332-21hddtemp_smartct23:15:141
888899128,2cyclictest0-21swapper/123:46:021
888899128,2cyclictest0-21swapper/120:40:131
888899127,3cyclictest27704-21fschecks_count21:45:161
888899127,3cyclictest19212-21munin-node1
888899121,9cyclictest3427-21apt-get23:35:091
888899121,9cyclictest29542-21latency_hist22:55:001
888899121,9cyclictest28704-21grep00:35:121
888899121,9cyclictest0-21swapper/122:15:131
888899121,9cyclictest0-21swapper/100:20:191
888899121,6cyclictest0-21swapper/120:55:011
888899121,3cyclictest12625-21perl20:35:111
888899121,3cyclictest0-21swapper/120:15:131
888899120,2cyclictest25545-21diskmemload21:39:531
888899120,2cyclictest0-21swapper/123:55:281
888899120,2cyclictest0-21swapper/123:52:051
888899120,2cyclictest0-21swapper/122:36:231
888899120,2cyclictest0-21swapper/119:20:301
888899120,11cyclictest0-21swapper/121:18:011
888899120,11cyclictest0-21swapper/121:05:151
888899120,10cyclictest23444-21unixbench_singl23:21:041
888899120,10cyclictest0-21swapper/123:05:111
888899120,10cyclictest0-21swapper/122:05:501
888799129,2cyclictest25545-21diskmemload23:25:090
888799129,2cyclictest0-21swapper/023:09:000
888799129,2cyclictest0-21swapper/022:56:530
888799129,2cyclictest0-21swapper/020:10:120
888799122,6cyclictest0-21swapper/021:25:010
888799120,2cyclictest0-21swapper/022:01:080
888799120,11cyclictest0-21swapper/020:53:080
888799120,11cyclictest0-21swapper/019:55:140
888799120,11cyclictest0-21swapper/019:15:040
888799120,11cyclictest0-21swapper/000:00:160
888799120,11cyclictest0-21swapper/000:00:160
85812120,2sleep225545-21diskmemload00:14:272
32932120,2sleep10-21swapper/121:53:481
889099118,2cyclictest0-21swapper/320:20:103
889099118,2cyclictest0-21swapper/319:55:123
889099111,5cyclictest0-21swapper/320:40:113
888999110,9cyclictest0-21swapper/200:36:002
888999110,10cyclictest0-21swapper/200:25:042
888899112,5cyclictest0-21swapper/123:15:001
888899111,8cyclictest28253-21iostat00:00:161
888899111,8cyclictest28253-21iostat00:00:151
888899111,8cyclictest0-21swapper/122:40:181
888899111,8cyclictest0-21swapper/122:25:161
888899111,8cyclictest0-21swapper/122:10:171
888899111,5cyclictest0-21swapper/119:30:001
888899111,3cyclictest21748-21munin-node1
888899111,2cyclictest0-21swapper/100:10:141
888899110,9cyclictest11704-21munin-node1
888899110,9cyclictest0-21swapper/120:20:091
888899110,9cyclictest0-21swapper/119:55:171
888899110,9cyclictest0-21swapper/119:40:131
888899110,9cyclictest0-21swapper/100:10:011
888899110,2cyclictest0-21swapper/123:40:181
888899110,2cyclictest0-21swapper/121:40:181
888899110,2cyclictest0-21swapper/121:10:391
888899110,10cyclictest0-21swapper/121:25:031
888899110,10cyclictest0-21swapper/121:20:411
888799111,4cyclictest0-21swapper/020:45:010
323472110,7sleep10-21swapper/123:30:371
168992110,2sleep20-21swapper/222:07:172
889099100,9cyclictest0-21swapper/320:50:163
888899107,2cyclictest25545-21diskmemload22:45:111
888899106,2cyclictest0-21swapper/120:55:141
888899105,3cyclictest9638-21sed00:15:131
888899105,3cyclictest4173-21gdbus20:05:021
888899105,3cyclictest23738-21aten2.4_r3power00:30:121
888899101,7cyclictest0-21swapper/121:30:131
888899101,5cyclictest0-21swapper/119:45:001
888899100,8cyclictest0-21swapper/120:25:131
888799107,2cyclictest0-21swapper/020:45:120
888799107,2cyclictest0-21swapper/020:36:000
888799107,2cyclictest0-21swapper/020:30:010
888799107,2cyclictest0-21swapper/019:42:070
888799105,3cyclictest23818-21grep19:45:130
888799100,3cyclictest274-21jbd2/sda1-819:20:190
86272100,2sleep00-21swapper/020:25:160
203792100,1sleep00-21swapper/019:35:590
88909994,3cyclictest3728-21runrttasks19:11:533
88909992,5cyclictest16797-21kworker/u8:219:31:003
88899994,3cyclictest13836-21unixbench_singl23:11:022
88889990,2cyclictest0-21swapper/119:30:111
21198290,2sleep30-21swapper/320:56:043
88879983,3cyclictest3531-21gdbus20:05:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional