You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 04:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sun Aug 02, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3323211999,15sleep30-21swapper/319:06:503
2768210788,12sleep20-21swapper/219:05:292
3425210178,18sleep00-21swapper/019:08:040
350529478,11sleep10-21swapper/119:09:051
312862810,0sleep00-21swapper/021:23:130
17112760,0sleep30-21swapper/323:05:503
254442740,1sleep10-21swapper/123:30:161
188992280,0sleep10-21swapper/121:44:181
154462220,1sleep0101ktimersoftd/023:53:210
361199211,15cyclictest0-21swapper/322:28:043
361199210,4cyclictest0-21swapper/321:45:043
360899210,19cyclictest0-21swapper/120:10:141
361199201,18cyclictest0-21swapper/323:44:053
361199200,3cyclictest0-21swapper/323:57:053
361199200,3cyclictest0-21swapper/322:58:053
361199200,3cyclictest0-21swapper/322:02:043
361199200,3cyclictest0-21swapper/300:07:043
360899200,18cyclictest0-21swapper/120:05:121
217872200,0sleep30-21swapper/300:33:123
361199192,2cyclictest0-21swapper/319:14:063
361199190,4cyclictest0-21swapper/320:14:023
361199184,2cyclictest0-21swapper/320:36:063
361199182,1cyclictest0-21swapper/300:39:043
361199181,2cyclictest0-21swapper/320:06:043
361199172,4cyclictest0-21swapper/321:07:053
361199172,11cyclictest0-21swapper/323:23:053
361199171,5cyclictest0-21swapper/320:44:053
361199171,2cyclictest0-21swapper/321:04:053
361199171,2cyclictest0-21swapper/321:04:043
361199170,2cyclictest0-21swapper/300:28:043
3608991712,3cyclictest0-21swapper/121:34:061
360899171,14cyclictest0-21swapper/123:58:051
178012170,1sleep217800-21munin-run21:10:012
361199163,11cyclictest37-21rcuc/300:10:163
361199161,2cyclictest0-21swapper/319:36:063
3611991611,3cyclictest11100-21ssh22:10:003
360999161,3cyclictest0-21swapper/219:11:052
360999161,13cyclictest26125-21ssh21:50:592
360999161,13cyclictest10116-21sh22:08:302
360899161,13cyclictest12390-21ntp_states22:10:191
3608991611,3cyclictest0-21swapper/122:54:151
361199150,13cyclictest12621-21pzem_energy22:10:293
360999151,3cyclictest31146-21ssh22:30:142
360999151,3cyclictest0-21swapper/223:53:102
3609991511,3cyclictest0-21swapper/223:36:022
360999151,12cyclictest3649-21snmpd21:00:202
360999151,12cyclictest3649-21snmpd21:00:192
3609991510,3cyclictest25404-21ssh00:36:162
360999150,3cyclictest22411-21munin-node2
360999150,3cyclictest21327-21telnet22:20:122
3608991510,3cyclictest16239-21ssh22:15:051
3608991510,3cyclictest11191-21chrt22:10:001
360899150,3cyclictest20101-21taskset21:45:151
360899150,3cyclictest0-21swapper/120:15:151
360799150,13cyclictest0-21swapper/000:22:220
360799150,13cyclictest0-21swapper/000:22:210
360799150,13cyclictest0-21swapper/000:17:580
361199149,3cyclictest0-21swapper/321:14:413
361199140,3cyclictest0-21swapper/322:48:383
360999141,3cyclictest31195-21ssh21:56:202
3609991411,2cyclictest0-21swapper/223:12:182
360999141,11cyclictest13077-21ssh21:37:512
360999141,11cyclictest12677-21df20:55:132
360999141,11cyclictest12677-21df20:55:122
3609991410,2cyclictest0-21swapper/222:26:512
360999140,3cyclictest0-21swapper/222:49:162
360999140,3cyclictest0-21swapper/200:21:372
360999140,3cyclictest0-21swapper/200:21:372
360999140,2cyclictest0-21swapper/220:36:022
360999140,2cyclictest0-21swapper/200:26:002
360999140,13cyclictest0-21swapper/219:35:122
360999140,12cyclictest3649-21snmpd19:30:012
360999140,12cyclictest32052-21ssh23:04:252
360999140,12cyclictest24184-21ssh22:55:282
360999140,12cyclictest13605-21ssh22:11:232
360999140,12cyclictest0-21swapper/223:44:032
360999140,12cyclictest0-21swapper/222:37:512
360899149,3cyclictest9373-21diskstats00:20:141
360899149,3cyclictest9373-21diskstats00:20:131
3608991411,2cyclictest0-21swapper/123:39:461
3608991411,2cyclictest0-21swapper/122:24:361
3608991411,2cyclictest0-21swapper/121:54:451
3608991411,2cyclictest0-21swapper/121:13:161
3608991411,2cyclictest0-21swapper/100:05:551
360899141,11cyclictest23069-21cut00:00:421
360899140,13cyclictest0-21swapper/100:31:461
360899140,13cyclictest0-21swapper/100:14:461
360899140,12cyclictest24680-21sh00:35:461
360899140,12cyclictest13877-21aten2.4-expect00:25:111
360899140,12cyclictest0-21swapper/123:10:191
3607991411,2cyclictest20936-21ssh23:25:180
3607991411,2cyclictest0-21swapper/022:52:170
360799140,2cyclictest31159-21ls22:30:130
360799140,2cyclictest0-21swapper/023:38:280
360799140,13cyclictest0-21swapper/021:56:380
360799140,13cyclictest0-21swapper/000:08:170
360799140,12cyclictest8369-21ssh23:45:350
360799140,12cyclictest0-21swapper/023:34:400
360799140,12cyclictest0-21swapper/022:05:260
360799140,12cyclictest0-21swapper/021:10:010
360799140,12cyclictest0-21swapper/000:00:170
113522140,3sleep011362-21ssh22:42:340
361199139,2cyclictest0-21swapper/321:33:363
361199139,2cyclictest0-21swapper/319:55:113
361199138,3cyclictest17190-21ssh21:41:413
361199138,3cyclictest0-21swapper/322:52:093
361199131,10cyclictest0-21swapper/323:50:463
3611991310,2cyclictest0-21swapper/320:45:133
361199130,2cyclictest0-21swapper/320:56:053
361199130,2cyclictest0-21swapper/320:56:043
361199130,12cyclictest0-21swapper/321:52:003
361199130,11cyclictest2722-21ssh22:34:343
361199130,11cyclictest0-21swapper/322:37:583
3609991310,2cyclictest0-21swapper/223:55:082
3609991310,2cyclictest0-21swapper/223:20:192
3609991310,2cyclictest0-21swapper/221:30:242
3609991310,2cyclictest0-21swapper/221:15:172
3609991310,2cyclictest0-21swapper/220:30:022
360999130,2cyclictest0-21swapper/223:45:352
360999130,2cyclictest0-21swapper/223:25:172
360999130,2cyclictest0-21swapper/223:15:192
360999130,2cyclictest0-21swapper/222:43:382
360999130,2cyclictest0-21swapper/200:10:162
360999130,12cyclictest30633-21kworker/u8:120:21:042
360999130,12cyclictest0-21swapper/223:05:192
360999130,12cyclictest0-21swapper/222:52:172
360999130,12cyclictest0-21swapper/221:47:202
360999130,12cyclictest0-21swapper/221:41:322
360999130,12cyclictest0-21swapper/221:27:292
360999130,12cyclictest0-21swapper/221:20:012
360999130,12cyclictest0-21swapper/219:20:192
360999130,12cyclictest0-21swapper/200:32:412
360999130,11cyclictest0-21swapper/219:45:122
360899132,6cyclictest16660-21copy19:45:001
360899132,6cyclictest0-21swapper/100:15:001
3608991310,2cyclictest0-21swapper/123:47:361
3608991310,2cyclictest0-21swapper/123:43:061
3608991310,2cyclictest0-21swapper/123:25:071
3608991310,2cyclictest0-21swapper/123:07:061
3608991310,2cyclictest0-21swapper/123:03:081
3608991310,2cyclictest0-21swapper/121:38:071
3608991310,2cyclictest0-21swapper/119:55:131
3608991310,2cyclictest0-21swapper/119:45:171
360899130,2cyclictest0-21swapper/123:52:471
360899130,2cyclictest0-21swapper/122:30:161
360799131,2cyclictest3728-21runrttasks19:46:000
3607991310,2cyclictest17795-21diskmemload23:21:480
3607991310,2cyclictest17795-21diskmemload00:25:410
3607991310,2cyclictest0-21swapper/023:57:500
3607991310,2cyclictest0-21swapper/023:03:400
3607991310,2cyclictest0-21swapper/022:45:090
3607991310,2cyclictest0-21swapper/022:26:160
3607991310,2cyclictest0-21swapper/022:00:080
3607991310,2cyclictest0-21swapper/021:52:130
3607991310,2cyclictest0-21swapper/021:47:020
3607991310,2cyclictest0-21swapper/020:45:210
3607991310,2cyclictest0-21swapper/000:11:090
360799130,2cyclictest0-21swapper/022:35:520
360799130,2cyclictest0-21swapper/022:10:110
360799130,2cyclictest0-21swapper/021:27:460
360799130,2cyclictest0-21swapper/020:45:010
360799130,1cyclictest0-21swapper/021:10:270
360799130,12cyclictest0-21swapper/023:15:180
360799130,12cyclictest0-21swapper/023:06:590
360799130,12cyclictest0-21swapper/022:21:430
360799130,12cyclictest0-21swapper/000:37:580
360799130,12cyclictest0-21swapper/000:34:380
360799130,11cyclictest0-21swapper/022:56:590
278142130,2sleep20-21swapper/200:05:332
361199129,2cyclictest0-21swapper/322:21:173
361199129,2cyclictest0-21swapper/320:20:153
361199129,2cyclictest0-21swapper/300:17:093
361199127,3cyclictest25071-21tr23:30:143
361199122,7cyclictest0-21swapper/320:16:593
361199122,6cyclictest16660-21copy19:45:003
361199121,6cyclictest0-21swapper/300:25:013
361199121,6cyclictest0-21swapper/300:25:003
3611991210,1cyclictest0-21swapper/321:25:163
361199120,2cyclictest0-21swapper/321:19:063
361199120,11cyclictest0-21swapper/323:25:133
361199120,11cyclictest0-21swapper/323:10:133
361199120,11cyclictest0-21swapper/322:41:023
361199120,11cyclictest0-21swapper/320:25:163
361199120,10cyclictest0-21swapper/300:03:103
360999129,2cyclictest0-21swapper/222:15:092
360999129,2cyclictest0-21swapper/221:10:092
360999129,2cyclictest0-21swapper/220:13:032
360999120,11cyclictest4491-21kworker/u8:100:16:042
360999120,11cyclictest17795-21diskmemload23:31:482
360999120,11cyclictest0-21swapper/222:00:072
360999120,11cyclictest0-21swapper/219:15:192
360899129,2cyclictest0-21swapper/123:23:491
360899129,2cyclictest0-21swapper/123:15:261
360899129,2cyclictest0-21swapper/121:58:391
360899129,2cyclictest0-21swapper/120:30:151
360899129,2cyclictest0-21swapper/119:30:381
360899128,2cyclictest0-21swapper/120:45:151
360899127,3cyclictest8248-21cat20:45:011
360899127,3cyclictest14391-21munin-node1
360899127,3cyclictest14391-21munin-node1
360899127,3cyclictest13043-21iostat_ios20:55:161
360899127,3cyclictest13043-21iostat_ios20:55:151
360899123,5cyclictest0-21swapper/120:50:181
360899121,9cyclictest23370-21df_abs22:55:141
360899121,9cyclictest2034-21latency_hist20:30:011
360899121,9cyclictest0-21swapper/119:20:171
360899121,6cyclictest0-21swapper/122:35:001
360899120,2cyclictest0-21swapper/122:48:591
360899120,2cyclictest0-21swapper/122:40:061
360899120,2cyclictest0-21swapper/122:04:171
360899120,2cyclictest0-21swapper/121:20:211
360899120,2cyclictest0-21swapper/121:16:061
360899120,11cyclictest0-21swapper/121:25:111
360899120,11cyclictest0-21swapper/119:15:511
360899120,10cyclictest0-21swapper/120:36:001
360799129,2cyclictest0-21swapper/023:10:020
360799129,2cyclictest0-21swapper/021:42:170
360799129,2cyclictest0-21swapper/021:35:080
360799129,2cyclictest0-21swapper/020:20:150
360799129,2cyclictest0-21swapper/020:05:150
360799129,2cyclictest0-21swapper/019:20:300
360799120,2cyclictest0-21swapper/023:40:430
360799120,2cyclictest0-21swapper/021:31:010
360799120,11cyclictest6106-21kworker/u8:119:17:050
360799120,11cyclictest0-21swapper/022:15:010
360799120,11cyclictest0-21swapper/021:15:350
128372120,2sleep30-21swapper/319:33:103
361199118,2cyclictest0-21swapper/323:47:133
361199118,2cyclictest0-21swapper/322:17:033
361199116,3cyclictest17143-21tr19:45:133
361199110,2cyclictest0-21swapper/321:22:393
361199110,10cyclictest6106-21kworker/u8:119:52:053
361199110,10cyclictest0-21swapper/323:35:203
361199110,10cyclictest0-21swapper/323:18:193
361199110,10cyclictest0-21swapper/321:55:423
360999118,2cyclictest0-21swapper/219:57:042
360999110,10cyclictest22548-21kworker/u8:020:15:052
360999110,10cyclictest0-21swapper/220:05:152
360999110,10cyclictest0-21swapper/219:53:102
360899111,6cyclictest0-21swapper/120:00:081
360899111,3cyclictest13881-21iostat_ios19:35:161
360899111,2cyclictest0-21swapper/119:10:141
360899110,9cyclictest16693-21cut21:05:141
360899110,9cyclictest0-21swapper/122:25:131
360899110,10cyclictest0-21swapper/119:53:481
301272110,2sleep317795-21diskmemload23:01:293
361199107,2cyclictest0-21swapper/321:35:153
361199107,2cyclictest0-21swapper/320:30:153
361199107,2cyclictest0-21swapper/319:19:023
361199105,3cyclictest10627-21tr20:50:143
360999100,9cyclictest0-21swapper/220:53:462
360999100,1cyclictest0-21swapper/219:29:032
360899101,7cyclictest10433-21needreboot19:25:171
360899100,2cyclictest0-21swapper/120:20:121
360799107,2cyclictest0-21swapper/020:53:130
360799107,2cyclictest0-21swapper/019:50:190
360799101,3cyclictest28310-21cron20:14:590
360799100,9cyclictest30633-21kworker/u8:120:25:040
360799100,2cyclictest0-21swapper/019:33:380
36119996,2cyclictest39-21ksoftirqd/319:20:123
36119994,3cyclictest37-21rcuc/319:28:453
36119994,3cyclictest23037-21fschecks_time20:00:143
36099996,2cyclictest0-21swapper/220:00:182
36099994,3cyclictest8450-21telnet20:45:132
36099990,2cyclictest0-21swapper/220:40:222
36079996,2cyclictest0-21swapper/020:00:060
36079994,3cyclictest31055-1kworker/0:1H20:15:160
36079993,5cyclictest0-21swapper/020:34:060
36079990,8cyclictest17962-21kworker/u8:019:14:010
36079990,2cyclictest0-21swapper/019:37:580
32572290,2sleep20-21swapper/220:25:102
36099983,3cyclictest0-21swapper/219:40:012
36079983,3cyclictest20876-21munin-node0
36079980,2cyclictest0-21swapper/021:01:070
36079980,2cyclictest0-21swapper/021:01:060
36079980,2cyclictest0-21swapper/020:37:260
36079980,2cyclictest0-21swapper/019:43:170
36079980,2cyclictest0-21swapper/019:28:570
36079972,3cyclictest13235-21ntpdc20:55:170
36079972,3cyclictest13235-21ntpdc20:55:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional