You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 12:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Jul 22, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2282021540,5sleep22873799cyclictest22:26:042
285362119108,6sleep30-21swapper/319:07:473
28632210897,6sleep20-21swapper/219:09:012
28419210897,6sleep10-21swapper/119:06:161
28558210695,6sleep00-21swapper/019:08:040
91032940,5sleep22873799cyclictest21:00:152
78852720,0sleep20-21swapper/219:36:012
83742590,3sleep337-21rcuc/322:45:143
54122580,0sleep05411-21perl21:35:160
196492560,0sleep30-21swapper/321:50:133
28738992510,13cyclictest0-21swapper/320:15:133
109352250,0sleep10-21swapper/100:26:531
2873699240,18cyclictest0-21swapper/122:10:121
2873799234,16cyclictest0-21swapper/223:12:052
213522230,0sleep20-21swapper/200:05:132
28737992219,2cyclictest31024-21kworker/u8:100:16:052
28738992118,2cyclictest21082-21kworker/u8:100:05:053
28737992118,2cyclictest28896-21kworker/u8:122:16:052
28738992017,2cyclictest5381-21kworker/u8:222:10:053
28738992017,2cyclictest23028-21kworker/u8:022:00:053
28738992017,2cyclictest21923-21kworker/u8:023:00:023
28738992017,2cyclictest2143-21kworker/u8:121:40:043
2873899200,15cyclictest0-21swapper/321:38:023
2873799200,18cyclictest0-21swapper/221:30:062
28736992016,2cyclictest0-21swapper/120:15:121
28738991916,2cyclictest7201-21kworker/u8:023:17:053
28738991916,2cyclictest6161-21kworker/u8:200:31:053
28738991916,2cyclictest28896-21kworker/u8:122:20:023
28738991916,2cyclictest27351-21kworker/u8:221:45:053
28738991916,2cyclictest27351-21kworker/u8:221:30:023
28738991916,2cyclictest25075-21kworker/u8:019:13:043
28738991914,3cyclictest27335-21ssh21:58:063
28737991916,2cyclictest6161-21kworker/u8:200:38:042
28737991916,2cyclictest6161-21kworker/u8:200:29:052
28737991916,2cyclictest29923-21kworker/u8:021:10:052
28737991916,2cyclictest27351-21kworker/u8:221:51:052
28737991916,2cyclictest22060-21kworker/u8:223:50:052
28737991916,2cyclictest20896-21kworker/u8:122:32:042
28737991916,2cyclictest14531-21kworker/u8:220:01:052
28737991916,2cyclictest12723-21kworker/u8:123:37:052
28737991916,2cyclictest11682-21kworker/u8:100:30:052
2873799190,18cyclictest0-21swapper/200:04:022
2873499190,2cyclictest0-21swapper/021:28:060
2873499190,18cyclictest0-21swapper/023:01:050
2873499190,18cyclictest0-21swapper/022:12:050
176682190,0sleep20-21swapper/223:27:452
28738991815,2cyclictest27573-21kworker/u8:223:10:023
28738991815,2cyclictest22882-21kworker/u8:300:15:053
28738991815,2cyclictest22882-21kworker/u8:300:13:053
28738991815,2cyclictest22060-21kworker/u8:223:44:053
28738991815,2cyclictest15946-21kworker/u8:022:38:063
28738991815,2cyclictest12758-21kworker/u8:121:18:053
28738991815,2cyclictest12723-21kworker/u8:123:26:053
28738991815,2cyclictest10723-21kworker/u8:022:52:053
2873899180,2cyclictest0-21swapper/319:21:043
28737991815,2cyclictest29923-21kworker/u8:021:09:052
28737991815,2cyclictest29923-21kworker/u8:020:57:052
28737991815,2cyclictest28896-21kworker/u8:122:11:052
28737991815,2cyclictest28111-21kworker/u8:023:42:062
28737991815,2cyclictest2560-21kworker/u8:122:42:022
28737991815,2cyclictest22060-21kworker/u8:223:46:042
28737991815,2cyclictest21923-21kworker/u8:023:09:052
28737991815,2cyclictest12758-21kworker/u8:121:15:042
2873799180,12cyclictest0-21swapper/223:32:042
28734991815,2cyclictest1478-21kworker/u8:123:12:040
2873499180,2cyclictest0-21swapper/023:55:120
2873899172,2cyclictest7970-21timerwakeupswit20:56:053
28738991714,2cyclictest7919-21kworker/u8:123:55:043
28738991714,2cyclictest7919-21kworker/u8:123:54:053
28738991714,2cyclictest29468-21kworker/u8:222:59:053
28738991714,2cyclictest27351-21kworker/u8:221:26:023
28738991714,2cyclictest2560-21kworker/u8:122:40:013
28738991714,2cyclictest19981-21kworker/u8:120:32:053
28738991714,2cyclictest15946-21kworker/u8:022:30:063
28738991714,2cyclictest13927-21kworker/u8:000:26:023
28738991714,2cyclictest12758-21kworker/u8:121:20:053
28738991714,2cyclictest11823-21kworker/u8:119:59:043
28738991714,2cyclictest11823-21kworker/u8:119:39:043
2873899170,2cyclictest0-21swapper/322:25:053
2873899170,12cyclictest0-21swapper/320:27:043
2873899170,12cyclictest0-21swapper/319:31:053
28737991714,2cyclictest7201-21kworker/u8:023:20:042
28737991714,2cyclictest6161-21kworker/u8:200:22:012
28737991714,2cyclictest29468-21kworker/u8:222:58:042
28737991714,2cyclictest28896-21kworker/u8:122:05:042
28737991714,2cyclictest22378-21kworker/u8:020:15:042
28737991714,2cyclictest22378-21kworker/u8:020:13:052
28737991714,2cyclictest19981-21kworker/u8:120:50:042
28737991714,2cyclictest16885-21kworker/u8:321:47:052
28737991714,2cyclictest11823-21kworker/u8:119:58:052
28737991714,2cyclictest11823-21kworker/u8:119:53:052
28737991714,2cyclictest11823-21kworker/u8:119:53:042
28737991714,2cyclictest11823-21kworker/u8:119:48:052
28737991714,2cyclictest11823-21kworker/u8:119:33:032
2873799170,2cyclictest0-21swapper/222:49:052
28734991714,2cyclictest29923-21kworker/u8:020:56:040
28738991613,2cyclictest7201-21kworker/u8:023:24:063
28738991613,2cyclictest6161-21kworker/u8:200:35:053
28738991613,2cyclictest28111-21kworker/u8:023:45:053
28738991613,2cyclictest11823-21kworker/u8:120:00:043
28738991613,2cyclictest11823-21kworker/u8:119:40:043
28738991613,2cyclictest11823-21kworker/u8:119:29:053
2873899160,12cyclictest0-21swapper/300:24:043
28737991613,2cyclictest28896-21kworker/u8:122:03:052
28737991613,2cyclictest23028-21kworker/u8:021:55:052
28737991613,2cyclictest19981-21kworker/u8:120:31:052
28737991613,2cyclictest19981-21kworker/u8:120:07:052
28737991613,2cyclictest12758-21kworker/u8:121:23:052
2873799160,2cyclictest0-21swapper/221:37:052
2873699161,3cyclictest0-21swapper/121:30:151
28738991512,2cyclictest381ktimersoftd/322:09:053
28738991512,2cyclictest28896-21kworker/u8:122:15:043
28738991512,2cyclictest12723-21kworker/u8:123:35:053
28738991512,2cyclictest12723-21kworker/u8:123:34:013
2873899150,2cyclictest0-21swapper/323:05:043
2873899150,10cyclictest0-21swapper/320:12:053
2873799151,3cyclictest9291-21ssh23:19:412
28737991512,2cyclictest19981-21kworker/u8:120:47:052
2873799150,13cyclictest28947-21munin-node2
2873799150,13cyclictest0-21swapper/223:04:052
2873699151,12cyclictest4613-21apt-get23:15:071
2873699151,12cyclictest4529-21ssh00:20:181
2873699150,3cyclictest0-21swapper/121:00:161
2873499151,12cyclictest18816-21apt-get20:05:120
2873499150,2cyclictest0-21swapper/020:30:110
2873499150,13cyclictest20889-21apt-get00:05:060
2873499150,13cyclictest0-21swapper/021:51:550
28738991411,2cyclictest6704-21kworker/u8:221:00:053
28738991411,2cyclictest29923-21kworker/u8:021:06:063
28738991411,2cyclictest19981-21kworker/u8:120:40:053
28738991411,2cyclictest19981-21kworker/u8:120:20:023
28738991411,2cyclictest11823-21kworker/u8:119:16:003
28737991411,2cyclictest19981-21kworker/u8:120:36:022
28737991411,2cyclictest11823-21kworker/u8:119:26:052
28737991411,2cyclictest10723-21kworker/u8:022:53:052
2873799140,2cyclictest0-21swapper/222:21:052
2873799140,12cyclictest0-21swapper/220:41:052
2873699149,3cyclictest22086-21ssh00:39:071
2873699142,7cyclictest0-21swapper/123:30:011
2873699142,7cyclictest0-21swapper/123:00:001
2873699142,7cyclictest0-21swapper/100:00:011
2873699142,6cyclictest0-21swapper/119:55:011
2873699142,6cyclictest0-21swapper/119:55:001
2873699141,11cyclictest12495-21diskmemload23:35:401
28736991410,2cyclictest0-21swapper/100:00:171
2873699140,12cyclictest0-21swapper/123:00:131
2873699140,12cyclictest0-21swapper/120:05:191
2873499149,3cyclictest12028-21missed_timers22:15:170
28734991411,2cyclictest22060-21kworker/u8:223:32:050
28734991411,2cyclictest0-21swapper/023:43:160
28734991411,2cyclictest0-21swapper/022:50:260
28734991411,2cyclictest0-21swapper/022:30:050
28734991411,2cyclictest0-21swapper/021:10:150
28734991411,2cyclictest0-21swapper/000:04:550
2873499140,2cyclictest0-21swapper/023:07:160
2873499140,12cyclictest0-21swapper/021:50:000
2873499140,12cyclictest0-21swapper/021:15:180
212312140,1sleep123-21ksoftirqd/121:18:341
28738991310,2cyclictest6704-21kworker/u8:221:11:053
28738991310,2cyclictest0-21swapper/320:46:023
2873899130,2cyclictest0-21swapper/320:09:053
2873899130,2cyclictest0-21swapper/319:45:183
2873899130,2cyclictest0-21swapper/300:00:023
2873899130,12cyclictest0-21swapper/320:36:063
28737991310,2cyclictest0-21swapper/221:25:202
2873799130,2cyclictest0-21swapper/220:25:182
2873799130,12cyclictest0-21swapper/222:35:142
2873799130,12cyclictest0-21swapper/221:41:282
2873699138,3cyclictest32758-21turbostat19:20:001
2873699138,3cyclictest22574-21telnet21:20:141
2873699138,3cyclictest21632-21iostat_ios22:25:171
2873699138,3cyclictest0-21swapper/100:35:001
2873699132,6cyclictest0-21swapper/123:10:011
2873699132,6cyclictest0-21swapper/120:25:011
2873699131,3cyclictest0-21swapper/119:11:031
2873699131,2cyclictest12495-21diskmemload23:47:271
2873699131,2cyclictest0-21swapper/122:07:071
2873699131,10cyclictest12495-21diskmemload23:12:581
2873699131,10cyclictest0-21swapper/122:45:171
2873699131,10cyclictest0-21swapper/119:25:201
28736991310,2cyclictest0-21swapper/122:35:171
28736991310,2cyclictest0-21swapper/119:20:171
28736991310,2cyclictest0-21swapper/100:10:161
2873699130,2cyclictest207150irq/24-eth119:30:111
2873699130,2cyclictest0-21swapper/122:24:561
2873699130,12cyclictest0-21swapper/100:05:161
2873699130,11cyclictest0-21swapper/122:30:361
2873699130,11cyclictest0-21swapper/121:05:421
28734991310,2cyclictest27351-21kworker/u8:221:30:050
28734991310,2cyclictest0-21swapper/023:54:360
28734991310,2cyclictest0-21swapper/020:40:140
28734991310,2cyclictest0-21swapper/000:24:460
28734991310,2cyclictest0-21swapper/000:14:250
2873499130,2cyclictest0-21swapper/023:25:110
2873499130,12cyclictest0-21swapper/023:21:150
2873499130,12cyclictest0-21swapper/000:35:140
229882130,2sleep00-21swapper/022:26:160
2873899120,2cyclictest0-21swapper/319:51:053
2873899120,2cyclictest0-21swapper/319:51:053
2873799129,2cyclictest0-21swapper/223:55:062
2873799129,2cyclictest0-21swapper/200:10:102
2873799120,2cyclictest0-21swapper/219:15:052
2873799120,11cyclictest0-21swapper/220:21:042
2873699129,2cyclictest0-21swapper/123:43:081
2873699129,2cyclictest0-21swapper/122:41:071
2873699129,2cyclictest0-21swapper/121:50:271
2873699127,3cyclictest7538-21ntp_offset23:50:191
2873699127,3cyclictest597-21aten2.4_r3power20:40:151
2873699127,3cyclictest15298-21cut19:55:161
2873699127,3cyclictest0-21swapper/123:20:231
2873699127,3cyclictest0-21swapper/100:19:301
2873699124,6cyclictest0-21swapper/122:03:311
2873699121,9cyclictest12854-21apt-get21:10:131
2873699121,9cyclictest0-21swapper/121:35:131
2873699121,9cyclictest0-21swapper/120:35:121
2873699121,3cyclictest27882-21fschecks_count21:25:161
2873699121,3cyclictest2451-21munin-node1
2873699120,3cyclictest57082sleep120:51:011
2873699120,3cyclictest0-21swapper/121:55:161
2873699120,11cyclictest0-21swapper/123:33:241
2873699120,11cyclictest0-21swapper/122:15:141
2873699120,11cyclictest0-21swapper/120:30:121
2873699120,11cyclictest0-21swapper/120:10:171
2873699120,11cyclictest0-21swapper/120:00:151
2873499129,2cyclictest29468-21kworker/u8:222:49:040
2873499129,2cyclictest0-21swapper/022:55:180
2873499129,2cyclictest0-21swapper/022:40:150
2873499129,2cyclictest0-21swapper/022:20:170
2873499129,2cyclictest0-21swapper/022:05:150
2873499129,2cyclictest0-21swapper/020:20:190
2873499129,2cyclictest0-21swapper/019:45:160
2873499120,2cyclictest0-21swapper/000:15:060
2873499120,11cyclictest1478-21kworker/u8:123:16:050
2873499120,11cyclictest0-21swapper/022:02:390
2873499120,11cyclictest0-21swapper/020:45:170
2873499120,11cyclictest0-21swapper/020:15:160
2873499120,11cyclictest0-21swapper/000:30:150
2873499120,11cyclictest0-21swapper/000:26:020
2873699117,2cyclictest0-21swapper/120:56:031
2873699112,6cyclictest0-21swapper/122:50:011
2873699111,8cyclictest27550-21iostat_ios20:25:191
2873699111,8cyclictest0-21swapper/119:35:151
2873699111,3cyclictest0-21swapper/119:40:151
2873699110,3cyclictest0-21swapper/119:45:211
2873699110,2cyclictest12495-21diskmemload21:43:111
2873699110,2cyclictest0-21swapper/121:46:351
2873499118,2cyclictest12495-21diskmemload21:20:130
2873499118,2cyclictest0-21swapper/019:30:390
2873499118,2cyclictest0-21swapper/019:25:150
2873499110,10cyclictest12495-21diskmemload21:40:240
2873499110,10cyclictest0-21swapper/023:45:320
263062110,1sleep00-21swapper/023:36:050
251692110,1sleep00-21swapper/021:55:240
2873799107,2cyclictest0-21swapper/219:40:142
2873799105,3cyclictest1374-21tail19:20:172
2873499107,2cyclictest0-21swapper/022:35:150
2873499107,2cyclictest0-21swapper/021:00:150
2873499101,8cyclictest274-21jbd2/sda1-819:16:050
2873499100,2cyclictest0-21swapper/019:36:040
287389990,2cyclictest0-21swapper/320:52:043
287349996,2cyclictest25075-21kworker/u8:019:12:010
287349996,2cyclictest0-21swapper/020:35:010
287349995,2cyclictest4675-21aten2.4_r3power20:50:120
287349994,3cyclictest9393-21ethtool19:40:160
287349994,3cyclictest3152-21nscd19:20:110
287349994,3cyclictest12650-21cut21:09:590
287349985,2cyclictest21588-21latency20:10:180
287349985,2cyclictest11823-21kworker/u8:119:51:050
287349985,2cyclictest11823-21kworker/u8:119:51:050
287349985,2cyclictest0-21swapper/020:01:030
287349984,3cyclictest16049-21cat19:56:040
287349983,3cyclictest27042-21cpu20:25:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional