You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 08:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Fri Jul 24, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2712721070,1sleep227126-21ssh00:23:052
18067210695,6sleep20-21swapper/219:06:302
17570210579,6sleep00-21swapper/019:05:290
16552210078,14sleep10-21swapper/119:05:091
1823529888,6sleep30-21swapper/319:08:393
87172800,0sleep20-21swapper/223:30:142
54392800,0sleep20-21swapper/222:19:442
54392800,0sleep20-21swapper/222:19:432
90752710,0sleep10-21swapper/122:22:471
90752710,0sleep10-21swapper/122:22:471
316612600,0sleep20-21swapper/223:54:392
1836799360,2cyclictest0-21swapper/000:15:130
176472270,0sleep00-21swapper/023:05:150
132242270,1sleep20-21swapper/200:08:502
51722250,0sleep00-21swapper/021:12:070
1836999231,20cyclictest10827-21ssh22:25:112
1836999231,20cyclictest10827-21ssh22:25:112
267492220,1sleep10-21swapper/123:49:291
71522210,1sleep10-21swapper/123:28:531
1836999210,16cyclictest0-21swapper/223:24:042
209852200,0sleep20-21swapper/222:01:242
18369992017,2cyclictest20830-21kworker/u8:123:44:042
1837099190,2cyclictest0-21swapper/321:48:053
1837099190,17cyclictest0-21swapper/322:28:053
1837099190,17cyclictest0-21swapper/322:28:053
18369991916,2cyclictest5671-21kworker/u8:221:34:012
18369991916,2cyclictest27593-21kworker/u8:222:42:042
18369991916,2cyclictest2441-21kworker/u8:121:44:052
18369991916,2cyclictest20830-21kworker/u8:123:47:042
18369991916,2cyclictest10230-21kworker/u8:121:10:042
18369991916,2cyclictest10230-21kworker/u8:120:15:042
1836999190,14cyclictest0-21swapper/223:39:042
1836899190,2cyclictest0-21swapper/120:20:091
18370991815,2cyclictest26440-21kworker/u8:100:27:043
18369991815,2cyclictest5619-21kworker/u8:023:28:042
18369991815,2cyclictest26768-21kworker/u8:219:46:042
1836899182,6cyclictest0-21swapper/100:00:001
18370991714,2cyclictest5671-21kworker/u8:221:35:043
18370991714,2cyclictest30743-21kworker/u8:222:14:043
18370991714,2cyclictest20628-21kworker/u8:000:20:043
1837099171,13cyclictest25564-21ssh22:06:043
18369991714,2cyclictest23959-21kworker/u8:119:21:042
18369991714,2cyclictest20628-21kworker/u8:000:17:042
1836999170,12cyclictest0-21swapper/223:10:042
1836999170,12cyclictest0-21swapper/220:47:042
18370991613,2cyclictest5619-21kworker/u8:023:54:043
18370991613,2cyclictest5619-21kworker/u8:023:27:043
18370991613,2cyclictest395-21kworker/u8:122:53:043
18370991612,3cyclictest12951-21ssh23:35:073
18370991612,2cyclictest17832-21kworker/u8:122:23:043
18370991612,2cyclictest17832-21kworker/u8:122:23:043
1836999161,3cyclictest0-21swapper/219:10:142
18369991613,2cyclictest8386-21kworker/u8:021:52:042
18369991613,2cyclictest5671-21kworker/u8:221:27:042
18369991613,2cyclictest3896-21kworker/u8:022:21:042
18369991613,2cyclictest3896-21kworker/u8:022:21:042
18369991613,2cyclictest27593-21kworker/u8:223:04:042
18369991613,2cyclictest24644-21kworker/u8:220:59:042
18369991613,2cyclictest17832-21kworker/u8:122:07:022
18369991613,2cyclictest13571-21kworker/u8:020:41:042
18369991613,2cyclictest13571-21kworker/u8:020:34:012
18369991613,2cyclictest10230-21kworker/u8:120:54:042
18369991613,2cyclictest10230-21kworker/u8:120:22:042
18369991611,3cyclictest0-21swapper/219:40:172
1836999160,7cyclictest0-21swapper/223:55:022
1836999160,2cyclictest0-21swapper/222:11:042
1836999160,2cyclictest0-21swapper/221:38:042
18368991613,2cyclictest0-21swapper/100:40:001
1836799161,13cyclictest8552-21ssh22:55:180
1836799161,13cyclictest0-21swapper/023:10:140
18370991512,2cyclictest5671-21kworker/u8:221:34:053
18370991512,2cyclictest5671-21kworker/u8:221:24:043
18370991512,2cyclictest30743-21kworker/u8:222:17:043
18370991512,2cyclictest30743-21kworker/u8:222:17:043
18370991512,2cyclictest26768-21kworker/u8:220:06:013
18370991512,2cyclictest13571-21kworker/u8:020:44:053
18370991512,2cyclictest13571-21kworker/u8:020:24:013
18370991511,2cyclictest24644-21kworker/u8:220:56:043
18369991512,2cyclictest26412-21kworker/u8:200:10:042
18369991512,2cyclictest2441-21kworker/u8:121:49:042
18369991512,2cyclictest23959-21kworker/u8:119:25:042
18369991512,2cyclictest2024-21diskmemload00:04:472
18369991512,2cyclictest16842-21kworker/u8:022:37:042
18369991512,2cyclictest12420-21kworker/u8:121:23:042
18369991512,2cyclictest10230-21kworker/u8:120:29:042
18369991512,2cyclictest10230-21kworker/u8:120:11:042
1836999150,2cyclictest1391-21sensors_fan21:06:042
1836999150,13cyclictest0-21swapper/200:38:042
1836899150,13cyclictest0-21swapper/100:21:451
1836799151,3cyclictest24072-21diskstats22:05:140
1836799151,2cyclictest0-21swapper/019:45:010
1836799150,13cyclictest0-21swapper/020:45:130
1837099142,7cyclictest0-21swapper/319:15:013
1837099142,6cyclictest0-21swapper/319:40:013
18370991411,2cyclictest6408-21kworker/u8:023:03:043
18370991411,2cyclictest5671-21kworker/u8:222:00:053
18370991411,2cyclictest31569-21kworker/u8:100:02:053
18370991411,2cyclictest27593-21kworker/u8:223:22:043
18370991411,2cyclictest27593-21kworker/u8:223:12:043
18370991411,2cyclictest27593-21kworker/u8:222:58:043
18370991411,2cyclictest26412-21kworker/u8:223:55:053
18370991411,2cyclictest24644-21kworker/u8:221:00:043
18370991411,2cyclictest20830-21kworker/u8:123:45:043
18370991411,2cyclictest18365-21kworker/u8:123:08:013
18370991411,2cyclictest17832-21kworker/u8:122:35:043
18370991411,2cyclictest13709-21kworker/u8:223:42:043
18369991411,2cyclictest16185-21kworker/u8:020:00:042
18369991411,2cyclictest16185-21kworker/u8:019:59:042
18369991411,2cyclictest10230-21kworker/u8:121:02:042
18369991411,2cyclictest10230-21kworker/u8:120:37:042
1836999140,13cyclictest0-21swapper/222:33:372
1836999140,12cyclictest0-21swapper/222:50:112
1836999140,12cyclictest0-21swapper/222:48:022
1836999140,12cyclictest0-21swapper/221:15:132
1836999140,12cyclictest0-21swapper/200:32:042
1836899149,3cyclictest31555-21diskstats23:20:141
1836899141,10cyclictest0-21swapper/123:41:021
18368991410,2cyclictest0-21swapper/122:52:441
18368991410,2cyclictest0-21swapper/120:55:201
1836899140,2cyclictest0-21swapper/120:51:031
1836899140,12cyclictest31884-21cut21:40:141
1836899140,12cyclictest2024-21diskmemload21:36:131
1836899140,12cyclictest10615-21basename20:10:121
1836899140,12cyclictest0-21swapper/123:10:071
1836899140,12cyclictest0-21swapper/121:19:461
1836799142,6cyclictest0-21swapper/020:40:000
1836799141,2cyclictest17536-21pzem_current20:25:180
18367991411,2cyclictest0-21swapper/023:53:440
1836799140,2cyclictest0-21swapper/019:50:140
1836799140,13cyclictest0-21swapper/023:15:140
1836799140,13cyclictest0-21swapper/022:15:040
1836799140,13cyclictest0-21swapper/022:15:040
1836799140,12cyclictest0-21swapper/023:58:260
1836799140,12cyclictest0-21swapper/022:22:430
1836799140,12cyclictest0-21swapper/022:22:430
1836799140,12cyclictest0-21swapper/000:30:150
160002140,2sleep10-21swapper/123:37:441
244672130,2sleep10-21swapper/122:39:071
1837099137,4cyclictest16499-21ssh00:11:273
1837099132,6cyclictest0-21swapper/320:40:003
1837099132,6cyclictest0-21swapper/320:05:003
1837099132,6cyclictest0-21swapper/300:35:003
18370991310,2cyclictest27593-21kworker/u8:222:48:043
18370991310,2cyclictest27593-21kworker/u8:222:44:043
18370991310,2cyclictest26768-21kworker/u8:219:47:043
18370991310,2cyclictest26768-21kworker/u8:219:32:043
18370991310,2cyclictest2441-21kworker/u8:121:44:013
18370991310,2cyclictest20628-21kworker/u8:000:18:013
18370991310,2cyclictest13571-21kworker/u8:020:26:043
18370991310,2cyclictest10230-21kworker/u8:121:08:023
18370991310,2cyclictest0-21swapper/319:20:193
1837099130,2cyclictest0-21swapper/321:59:043
1837099130,2cyclictest0-21swapper/321:54:043
1837099130,12cyclictest0-21swapper/320:45:193
1837099130,11cyclictest0-21swapper/321:27:293
1836999131,6cyclictest0-21swapper/220:10:012
18369991310,2cyclictest26768-21kworker/u8:219:37:042
18369991310,2cyclictest26768-21kworker/u8:219:33:042
18369991310,2cyclictest0-21swapper/223:07:312
18369991310,2cyclictest0-21swapper/222:56:272
18369991310,2cyclictest0-21swapper/221:58:272
18369991310,2cyclictest0-21swapper/200:27:482
1836999130,2cyclictest0-21swapper/223:18:102
1836899139,2cyclictest0-21swapper/120:30:171
1836899138,3cyclictest2024-21diskmemload22:41:031
1836899133,8cyclictest5115-21missed_timers21:45:171
1836899132,6cyclictest0-21swapper/120:45:001
1836899131,6cyclictest0-21swapper/120:05:001
1836899131,3cyclictest2024-21diskmemload00:10:151
1836899131,3cyclictest0-21swapper/123:15:111
18368991310,2cyclictest2024-21diskmemload23:30:571
18368991310,2cyclictest2024-21diskmemload00:09:451
18368991310,2cyclictest0-21swapper/122:19:051
18368991310,2cyclictest0-21swapper/122:19:051
18368991310,2cyclictest0-21swapper/121:52:061
1836899130,2cyclictest0-21swapper/122:01:251
1836899130,2cyclictest0-21swapper/119:20:151
1836899130,12cyclictest0-21swapper/122:10:061
1836899130,12cyclictest0-21swapper/100:03:251
1836899130,11cyclictest0-21swapper/100:31:261
18367991310,2cyclictest1937-21ssh21:42:110
18367991310,2cyclictest0-21swapper/022:50:080
18367991310,2cyclictest0-21swapper/022:30:120
18367991310,2cyclictest0-21swapper/021:28:030
18367991310,2cyclictest0-21swapper/021:20:300
18367991310,2cyclictest0-21swapper/019:25:130
1836799130,2cyclictest0-21swapper/023:25:440
1836799130,2cyclictest0-21swapper/022:48:450
1836799130,2cyclictest0-21swapper/022:40:240
1836799130,2cyclictest0-21swapper/022:03:380
1836799130,2cyclictest0-21swapper/021:48:590
1836799130,2cyclictest0-21swapper/021:15:160
1836799130,2cyclictest0-21swapper/019:30:170
1836799130,2cyclictest0-21swapper/000:10:520
1836799130,2cyclictest0-21swapper/000:01:440
1836799130,12cyclictest0-21swapper/023:45:030
1836799130,11cyclictest2024-21diskmemload00:35:150
1836799130,11cyclictest0-21swapper/023:30:030
1836799130,11cyclictest0-21swapper/022:35:040
1836799130,11cyclictest0-21swapper/021:55:480
1837099129,2cyclictest5671-21kworker/u8:221:14:043
1837099129,2cyclictest5013-21kworker/u8:000:39:043
1837099129,2cyclictest27593-21kworker/u8:223:15:043
1837099129,2cyclictest26768-21kworker/u8:219:50:013
1837099129,2cyclictest23959-21kworker/u8:119:26:053
1837099129,2cyclictest16185-21kworker/u8:019:15:043
1837099129,2cyclictest13571-21kworker/u8:020:32:043
1837099129,2cyclictest0-21swapper/322:30:393
1837099122,7cyclictest0-21swapper/323:31:593
1836999120,2cyclictest0-21swapper/219:15:302
1836999120,11cyclictest0-21swapper/219:50:302
1836899129,2cyclictest0-21swapper/123:54:141
1836899129,2cyclictest0-21swapper/122:31:241
1836899129,2cyclictest0-21swapper/121:30:261
1836899129,2cyclictest0-21swapper/121:25:251
1836899129,2cyclictest0-21swapper/120:18:251
1836899129,2cyclictest0-21swapper/100:15:351
1836899128,2cyclictest30680-21munin-node1
1836899127,3cyclictest2024-21diskmemload21:11:021
1836899127,3cyclictest0-21swapper/119:26:031
1836899121,9cyclictest2024-21diskmemload22:45:151
1836899121,3cyclictest13990-21apt-get21:55:121
1836899120,2cyclictest0-21swapper/123:05:191
1836899120,2cyclictest0-21swapper/123:00:141
1836899120,2cyclictest0-21swapper/122:26:271
1836899120,2cyclictest0-21swapper/122:26:271
1836899120,11cyclictest0-21swapper/122:55:451
1836899120,11cyclictest0-21swapper/122:05:261
1836899120,11cyclictest0-21swapper/121:24:471
1836899120,11cyclictest0-21swapper/120:45:141
1836899120,11cyclictest0-21swapper/100:25:141
1836799129,2cyclictest0-21swapper/023:44:380
1836799129,2cyclictest0-21swapper/023:36:380
1836799129,2cyclictest0-21swapper/023:20:060
1836799129,2cyclictest0-21swapper/023:00:120
1836799129,2cyclictest0-21swapper/022:25:110
1836799129,2cyclictest0-21swapper/022:25:100
1836799129,2cyclictest0-21swapper/021:50:080
1836799129,2cyclictest0-21swapper/020:05:190
1836799129,2cyclictest0-21swapper/000:25:070
1836799120,2cyclictest2024-21diskmemload21:30:230
1836799120,2cyclictest0-21swapper/021:01:010
1836799120,2cyclictest0-21swapper/020:00:150
1836799120,2cyclictest0-21swapper/000:06:010
1836799120,11cyclictest0-21swapper/022:10:190
1836799120,11cyclictest0-21swapper/021:36:480
1836799120,11cyclictest0-21swapper/019:10:160
1836799120,11cyclictest0-21swapper/000:20:250
1837099118,2cyclictest26768-21kworker/u8:220:10:043
1837099112,6cyclictest0-21swapper/320:52:583
1837099112,6cyclictest0-21swapper/300:05:013
1836899117,2cyclictest27565-21ntp_states19:30:171
1836899117,2cyclictest0-21swapper/119:15:141
1836899116,3cyclictest20567-21munin-node1
1836899116,3cyclictest16578-21aten2.4-expect20:25:111
1836899111,8cyclictest31010-21df19:40:131
1836899111,8cyclictest29066-21df_inode19:35:131
1836899110,9cyclictest4406-21munin-node1
1836899110,9cyclictest32715-21munin-node1
1836899110,9cyclictest0-21swapper/119:50:151
1836799118,2cyclictest26461-21copy20:50:030
1836799118,2cyclictest0-21swapper/020:25:010
1836799118,2cyclictest0-21swapper/020:10:170
1836799112,5cyclictest0-21swapper/019:40:010
1837099107,2cyclictest26768-21kworker/u8:219:40:013
1837099107,2cyclictest2024-21diskmemload21:15:153
1837099105,3cyclictest12601-21aten2.4-expect20:15:113
1836899106,2cyclictest18580-21munin-node1
1836899101,3cyclictest0-21swapper/120:05:171
1836799107,2cyclictest0-21swapper/019:55:190
1836799107,2cyclictest0-21swapper/019:45:110
1836799107,2cyclictest0-21swapper/019:20:310
1836799105,3cyclictest18797-21grep20:30:110
1836799105,3cyclictest14246-21sshd20:19:250
1836799101,6cyclictest0-21swapper/019:20:010
1836799101,5cyclictest0-21swapper/021:10:000
1836799101,5cyclictest0-21swapper/020:40:000
183709992,6cyclictest0-21swapper/319:57:583
183689990,7cyclictest32696-21apt-get21:05:131
183679994,3cyclictest0-21swapper/020:55:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional