You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 11:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Apr 18, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13375211099,6sleep10-21swapper/119:08:011
13520210897,6sleep20-21swapper/219:09:542
13312210796,6sleep00-21swapper/019:07:110
13419210387,11sleep30-21swapper/319:08:353
228152790,0sleep30-21swapper/322:42:333
251222720,0sleep30-21swapper/323:51:593
40242700,0sleep20-21swapper/200:37:382
310062660,0sleep00-21swapper/022:50:550
13557993415,17cyclictest0-21swapper/121:55:091
71962230,0sleep10-21swapper/100:06:521
179132230,1sleep20-21swapper/219:20:112
1355799221,2cyclictest0-21swapper/123:10:101
307102210,1sleep229-21rcuc/200:31:102
1355999210,19cyclictest0-21swapper/320:35:113
1355799211,2cyclictest0-21swapper/119:55:111
1355799210,19cyclictest0-21swapper/123:05:121
1355699201,2cyclictest2392-21ssh21:15:120
1355799190,2cyclictest0-21swapper/100:30:121
13558991815,2cyclictest26068-21kworker/u8:222:22:002
13558991815,2cyclictest16342-21kworker/u8:123:46:042
13558991815,2cyclictest15096-21kworker/u8:222:37:052
1355799180,13cyclictest0-21swapper/122:21:031
13558991714,2cyclictest7494-21kworker/u8:121:29:042
13558991714,2cyclictest32187-21kworker/u8:022:57:052
13558991714,2cyclictest31403-21kworker/u8:220:25:042
13558991714,2cyclictest25995-21kworker/u8:121:41:042
13558991712,3cyclictest29697-21diskmemload22:11:042
1355799172,13cyclictest23-21ksoftirqd/121:10:421
13557991714,2cyclictest4765-21kworker/u8:022:32:041
13557991714,2cyclictest20563-21kworker/u8:221:39:051
13557991714,2cyclictest15096-21kworker/u8:222:39:041
1355699170,12cyclictest0-21swapper/000:01:040
1355999160,14cyclictest0-21swapper/321:30:163
1355899161,3cyclictest16555-21memory19:15:172
13558991613,2cyclictest31353-21kworker/u8:021:12:042
13558991613,2cyclictest21206-21kworker/u8:023:19:052
13558991613,2cyclictest14420-21kworker/u8:100:20:062
13558991612,2cyclictest27731-21kworker/u8:200:29:042
13558991611,3cyclictest2392-21ssh21:15:122
13558991611,3cyclictest0-21swapper/220:10:152
1355899160,14cyclictest11313-21kworker/2:223:38:052
13557991613,2cyclictest8242-21kworker/u8:023:43:051
13557991613,2cyclictest28508-21kworker/u8:200:10:061
13557991613,2cyclictest25995-21kworker/u8:121:42:041
13557991613,2cyclictest19219-21kworker/u8:322:49:031
13557991613,2cyclictest13698-21kworker/u8:122:10:011
1355799161,13cyclictest24399-21diskstats00:25:131
150142151,2sleep015025-21ssh23:41:150
13559991510,3cyclictest1955-21grep22:21:003
1355999150,2cyclictest0-21swapper/322:05:153
1355899151,2cyclictest0-21swapper/221:23:042
13558991512,2cyclictest21206-21kworker/u8:023:20:042
13558991512,2cyclictest19852-21kworker/u8:119:58:042
13558991512,2cyclictest16342-21kworker/u8:123:44:052
13558991512,2cyclictest1578-21kworker/u8:222:01:052
13558991512,2cyclictest13487-21kworker/u8:020:34:012
1355899151,12cyclictest0-21swapper/221:34:142
13558991510,3cyclictest0-21swapper/223:12:492
1355899150,2cyclictest0-21swapper/221:56:042
1355899150,13cyclictest0-21swapper/222:40:112
1355899150,13cyclictest0-21swapper/221:35:342
13557991512,2cyclictest9645-21kworker/u8:122:54:041
13557991512,2cyclictest9645-21kworker/u8:122:43:051
13557991512,2cyclictest4955-21kworker/u8:222:59:041
13557991512,2cyclictest4719-21kworker/u8:120:27:041
13557991512,2cyclictest31937-21kworker/u8:322:19:041
13557991512,2cyclictest28508-21kworker/u8:223:22:041
13557991512,2cyclictest28508-21kworker/u8:200:16:051
13557991512,2cyclictest24943-21kworker/u8:020:57:031
13557991512,2cyclictest21927-21kworker/u8:121:03:041
13557991512,2cyclictest19852-21kworker/u8:119:51:041
1355799151,12cyclictest2365-21ssh21:48:111
13557991511,2cyclictest19856-21apt-get20:45:111
1355799150,2cyclictest29697-21diskmemload21:32:351
1355799150,2cyclictest0-21swapper/100:38:051
1355799150,11cyclictest0-21swapper/100:22:021
1355999149,3cyclictest13444-21ssh22:33:023
13559991411,2cyclictest0-21swapper/300:04:373
1355999140,2cyclictest27372-21ssh23:55:113
1355999140,2cyclictest0-21swapper/322:46:063
1355999140,2cyclictest0-21swapper/300:35:163
1355999140,12cyclictest29697-21diskmemload23:40:063
1355999140,12cyclictest29697-21diskmemload00:15:513
1355999140,12cyclictest0-21swapper/323:20:103
1355999140,12cyclictest0-21swapper/322:15:543
1355899149,3cyclictest0-21swapper/223:29:142
13558991411,2cyclictest4765-21kworker/u8:022:34:042
13558991411,2cyclictest32187-21kworker/u8:023:04:012
13558991411,2cyclictest28508-21kworker/u8:200:14:042
13558991411,2cyclictest26068-21kworker/u8:222:17:042
13558991411,2cyclictest24943-21kworker/u8:020:59:042
13558991411,2cyclictest23825-21kworker/u8:019:49:042
13558991411,2cyclictest23825-21kworker/u8:019:39:042
13558991411,2cyclictest21927-21kworker/u8:120:54:042
13558991411,2cyclictest16342-21kworker/u8:100:04:052
13558991411,2cyclictest13698-21kworker/u8:122:09:052
13558991411,2cyclictest0-21swapper/222:25:042
1355899140,2cyclictest0-21swapper/223:50:142
1355899140,2cyclictest0-21swapper/223:33:052
1355899140,12cyclictest6215-21ssh21:51:262
1355899140,10cyclictest0-21swapper/220:46:042
13557991411,2cyclictest4765-21kworker/u8:022:28:041
13557991411,2cyclictest31403-21kworker/u8:220:42:041
13557991411,2cyclictest31353-21kworker/u8:021:15:041
13557991411,2cyclictest29697-21diskmemload22:07:051
13557991411,2cyclictest23825-21kworker/u8:019:42:001
13557991411,2cyclictest1676-21kworker/u8:020:02:041
13557991411,2cyclictest16447-21kworker/u8:219:33:041
13557991411,2cyclictest1578-21kworker/u8:222:04:011
1355799140,3cyclictest14370-21munin-node1
1355799140,2cyclictest29697-21diskmemload21:23:041
1355799140,2cyclictest0-21swapper/121:54:041
1355799140,2cyclictest0-21swapper/121:27:351
1355799140,12cyclictest1892-21sh00:01:201
1355799140,12cyclictest0-21swapper/123:01:091
1355699140,13cyclictest0-21swapper/023:25:080
1355699140,13cyclictest0-21swapper/023:02:040
1355699140,12cyclictest0-21swapper/023:22:280
245832130,2sleep129697-21diskmemload23:51:101
184642130,2sleep10-21swapper/123:45:171
1355999139,3cyclictest0-21swapper/323:10:113
13559991310,2cyclictest17440-21ssh22:03:543
13559991310,2cyclictest0-21swapper/322:35:393
13559991310,2cyclictest0-21swapper/322:25:183
13559991310,2cyclictest0-21swapper/321:42:433
13559991310,2cyclictest0-21swapper/321:20:133
13559991310,2cyclictest0-21swapper/320:00:173
13559991310,2cyclictest0-21swapper/300:10:093
1355999130,3cyclictest26772-21ssh00:27:273
1355999130,2cyclictest0-21swapper/323:45:543
1355999130,2cyclictest0-21swapper/321:38:243
1355999130,2cyclictest0-21swapper/319:25:113
1355999130,12cyclictest0-21swapper/321:57:163
1355999130,12cyclictest0-21swapper/321:25:113
1355999130,11cyclictest3178-21ssh22:55:353
1355999130,11cyclictest29697-21diskmemload21:47:343
13558991310,2cyclictest31403-21kworker/u8:220:23:042
13558991310,2cyclictest31403-21kworker/u8:220:17:032
13558991310,2cyclictest21927-21kworker/u8:121:02:042
13558991310,2cyclictest13487-21kworker/u8:020:35:042
13558991310,2cyclictest0-21swapper/223:55:252
13558991310,2cyclictest0-21swapper/222:51:402
13558991310,2cyclictest0-21swapper/222:45:352
1355899130,2cyclictest0-21swapper/200:16:382
1355899130,12cyclictest0-21swapper/223:09:502
1355899130,11cyclictest0-21swapper/200:09:002
13557991310,2cyclictest4719-21kworker/u8:120:13:041
13557991310,2cyclictest4719-21kworker/u8:120:07:031
13557991310,2cyclictest23825-21kworker/u8:019:47:041
13557991310,2cyclictest21206-21kworker/u8:023:25:041
13557991310,2cyclictest16447-21kworker/u8:219:28:011
13557991310,2cyclictest0-21swapper/123:18:441
1355799130,8cyclictest0-21swapper/119:37:041
1355799130,2cyclictest0-21swapper/123:36:411
1355799130,2cyclictest0-21swapper/123:33:051
1355799130,12cyclictest0-21swapper/120:15:121
13556991310,2cyclictest0-21swapper/023:47:180
13556991310,2cyclictest0-21swapper/000:10:580
13556991310,2cyclictest0-21swapper/000:08:080
1355699130,2cyclictest18429-21diskmemload23:11:050
1355699130,12cyclictest0-21swapper/000:20:080
1355699130,11cyclictest0-21swapper/022:46:500
1355699130,11cyclictest0-21swapper/000:15:370
1355999129,2cyclictest0-21swapper/323:15:253
1355999129,2cyclictest0-21swapper/323:00:053
1355999129,2cyclictest0-21swapper/321:50:123
1355999129,2cyclictest0-21swapper/321:13:403
1355999129,2cyclictest0-21swapper/320:15:153
1355999129,2cyclictest0-21swapper/319:36:033
1355999120,2cyclictest29850-21ssh00:30:273
1355999120,2cyclictest0-21swapper/323:25:393
1355999120,2cyclictest0-21swapper/323:05:353
1355999120,2cyclictest0-21swapper/319:40:013
1355999120,11cyclictest0-21swapper/323:35:183
1355999120,11cyclictest0-21swapper/323:33:153
1355999120,11cyclictest0-21swapper/322:50:153
1355999120,11cyclictest0-21swapper/321:15:043
1355999120,11cyclictest0-21swapper/300:06:163
1355999120,10cyclictest0-21swapper/322:14:553
1355999120,10cyclictest0-21swapper/300:20:393
1355899129,2cyclictest16447-21kworker/u8:219:27:042
1355899127,3cyclictest0-21swapper/219:50:172
1355899120,2cyclictest0-21swapper/219:41:002
1355899120,2cyclictest0-21swapper/219:30:022
1355899120,11cyclictest0-21swapper/221:45:172
1355799129,2cyclictest16447-21kworker/u8:219:20:041
1355799121,9cyclictest15820-21apt-get20:35:121
1355799121,3cyclictest13767-21munin-node1
1355799120,8cyclictest0-21swapper/121:06:041
1355799120,3cyclictest0-21swapper/120:20:151
1355799120,2cyclictest0-21swapper/120:50:091
1355799120,11cyclictest0-21swapper/123:56:331
1355799120,11cyclictest0-21swapper/119:15:131
1355699129,2cyclictest0-21swapper/023:55:050
1355699129,2cyclictest0-21swapper/023:35:040
1355699129,2cyclictest0-21swapper/023:15:550
1355699121,10cyclictest27731-21kworker/u8:200:30:050
1355699120,2cyclictest0-21swapper/020:00:000
1355699120,11cyclictest16447-21kworker/u8:219:31:040
1355699120,11cyclictest0-21swapper/023:53:180
1355699120,11cyclictest0-21swapper/023:30:380
1355699120,11cyclictest0-21swapper/023:07:170
1355699120,11cyclictest0-21swapper/022:57:450
1355699120,11cyclictest0-21swapper/000:36:500
1355699120,11cyclictest0-21swapper/000:25:140
294262110,2sleep00-21swapper/022:15:450
194742110,1sleep00-21swapper/021:31:480
1355999118,2cyclictest23872-21apt-get20:55:103
1355999118,2cyclictest0-21swapper/320:14:203
1355999118,2cyclictest0-21swapper/319:45:133
1355999110,10cyclictest0-21swapper/320:41:203
1355899112,6cyclictest0-21swapper/220:41:002
1355899110,9cyclictest0-21swapper/220:05:002
1355699112,6cyclictest0-21swapper/019:36:590
1355699110,9cyclictest13661-21latency_hist20:30:000
1355699110,5cyclictest0-21swapper/022:22:060
31702100,1sleep00-21swapper/020:03:050
167942100,1sleep00-21swapper/019:15:290
166092100,6sleep00-21swapper/021:29:520
1355999105,3cyclictest29689-21cron21:10:003
1355999105,3cyclictest12290-21fschecks_time20:25:133
1355999102,6cyclictest0-21swapper/319:56:003
1355999101,5cyclictest0-21swapper/320:35:003
1355899101,5cyclictest0-21swapper/220:06:002
1355899100,2cyclictest0-21swapper/219:11:042
1355699107,2cyclictest29697-21diskmemload21:11:180
1355699107,2cyclictest0-21swapper/021:55:100
1355699103,6cyclictest0-21swapper/020:15:590
1355699102,5cyclictest0-21swapper/020:55:010
1355699100,9cyclictest29697-21diskmemload22:07:100
1355699100,9cyclictest0-21swapper/021:41:000
1355699100,7cyclictest4556-21metacity20:42:590
1355699100,7cyclictest0-21swapper/022:43:590
1355699100,7cyclictest0-21swapper/022:02:590
1355699100,7cyclictest0-21swapper/020:07:580
1355699100,7cyclictest0-21swapper/019:52:020
1355699100,2cyclictest9898-21apt22:30:000
24046290,1sleep00-21swapper/021:36:250
135599996,2cyclictest13770-21apt-get19:10:113
135599996,2cyclictest0-21swapper/319:15:143
135599994,3cyclictest3688-21Xorg19:21:593
135599994,3cyclictest26673-21missed_timers21:00:173
135599994,3cyclictest22673-21sed19:30:163
135599994,3cyclictest21952-21aten2.4-expect20:50:103
135599992,6cyclictest0-21swapper/320:21:013
135599991,5cyclictest0-21swapper/319:51:583
135589994,3cyclictest28387-21grep21:05:132
135569996,2cyclictest0-21swapper/022:12:450
135569996,2cyclictest0-21swapper/021:52:100
135569995,2cyclictest21647-21latency_hist20:50:000
135569991,6cyclictest0-21swapper/020:31:000
135569990,8cyclictest29697-21diskmemload21:45:210
135569990,8cyclictest29697-21diskmemload21:20:460
135569990,8cyclictest23825-21kworker/u8:019:40:040
135569990,8cyclictest0-21swapper/022:36:590
135569990,8cyclictest0-21swapper/022:30:100
135599985,2cyclictest0-21swapper/320:05:003
135599984,2cyclictest20427-21hddtemp_smartct20:45:143
135569985,2cyclictest0-21swapper/019:10:150
135569984,3cyclictest22733-21tr20:50:150
135569984,2cyclictest3728-21runrttasks21:09:400
135569983,3cyclictest6598-21tr20:10:180
135569983,3cyclictest11572-21cut20:25:000
135569980,7cyclictest0-21swapper/019:48:590
135569980,6cyclictest16137-21grep20:35:130
135569974,2cyclictest19814-21munin-node0
135569973,3cyclictest3150-21nscd19:20:130
135569973,2cyclictest26150-21tr21:00:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional