You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 17:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu May 07, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16431211497,12sleep30-21swapper/307:09:193
16431211497,12sleep30-21swapper/307:09:193
163872114103,6sleep20-21swapper/207:08:472
163872114103,6sleep20-21swapper/207:08:462
16236210796,6sleep00-21swapper/007:06:480
16236210796,6sleep00-21swapper/007:06:480
16391210685,16sleep10-21swapper/107:08:501
16391210685,16sleep10-21swapper/107:08:491
61822840,0sleep00-21swapper/012:10:000
130322710,0sleep20-21swapper/211:06:102
248912640,1sleep20-21swapper/212:30:102
12402630,0sleep00-21swapper/011:29:430
16513993616,18cyclictest0-21swapper/311:55:113
313752240,2sleep229-21rcuc/212:36:032
1651399230,2cyclictest0-21swapper/309:00:103
221532220,0sleep30-21swapper/308:41:013
16513992116,3cyclictest15639-21ssh11:10:103
1651399210,17cyclictest0-21swapper/308:06:023
16512992017,2cyclictest8428-21kworker/u8:208:10:042
16512992017,2cyclictest32323-21kworker/u8:111:04:042
16512992017,2cyclictest27385-21kworker/u8:010:48:052
16512992017,2cyclictest12968-21kworker/u8:108:45:042
16510992017,2cyclictest16538-21kworker/u8:210:19:040
16510992017,2cyclictest10020-21kworker/u8:111:50:040
215762190,0sleep30-21swapper/311:15:403
16511991916,2cyclictest24261-21kworker/u8:212:33:041
16510991916,2cyclictest414-21kworker/u8:107:50:040
16510991916,2cyclictest20159-21kworker/u8:210:58:050
16510991916,2cyclictest16889-21kworker/u8:207:33:040
16512991815,2cyclictest734-21kworker/u8:009:17:042
16512991815,2cyclictest6474-21kworker/u8:112:12:052
16512991815,2cyclictest27380-21kworker/u8:111:58:062
16512991815,2cyclictest20159-21kworker/u8:210:52:042
16511991815,2cyclictest19509-21kworker/u8:111:25:041
16511991815,2cyclictest13292-21kworker/u8:009:26:051
16510991815,2cyclictest5090-21kworker/u8:011:10:050
16510991815,2cyclictest19509-21kworker/u8:111:17:040
16510991815,2cyclictest15246-21kworker/u8:012:20:010
16510991815,2cyclictest15246-21kworker/u8:012:00:040
16510991815,2cyclictest12968-21kworker/u8:108:49:040
1651099181,2cyclictest0-21swapper/011:57:040
1651099180,16cyclictest0-21swapper/010:48:050
16512991714,2cyclictest8428-21kworker/u8:208:15:052
16512991714,2cyclictest8278-21kworker/u8:109:32:052
16512991714,2cyclictest3565-21kworker/u8:010:28:052
16512991714,2cyclictest30364-21kworker/u8:110:17:042
16512991714,2cyclictest12968-21kworker/u8:109:03:042
16511991714,2cyclictest5090-21kworker/u8:011:10:011
16511991714,2cyclictest29203-21kworker/u8:209:12:041
16511991714,2cyclictest27380-21kworker/u8:112:01:041
16511991714,2cyclictest16889-21kworker/u8:207:22:041
1651199170,15cyclictest0-21swapper/111:56:061
16510991714,2cyclictest9369-21kworker/u8:110:39:040
16510991714,2cyclictest8278-21kworker/u8:109:31:040
16510991714,2cyclictest6474-21kworker/u8:112:14:060
16510991714,2cyclictest5090-21kworker/u8:011:02:040
16510991714,2cyclictest30615-21kworker/u8:211:33:040
16510991714,2cyclictest12968-21kworker/u8:109:04:040
16510991712,3cyclictest11443-21fschecks_time08:15:130
1651099171,14cyclictest28851-40update-apt-xapi07:40:040
16512991613,2cyclictest5622-21kworker/u8:110:08:042
16512991613,2cyclictest414-21kworker/u8:108:00:042
16512991613,2cyclictest19509-21kworker/u8:111:32:052
16512991613,2cyclictest16538-21kworker/u8:210:13:042
16512991613,2cyclictest15246-21kworker/u8:011:54:012
16512991613,2cyclictest14683-21kworker/u8:010:35:042
16512991613,2cyclictest12968-21kworker/u8:108:42:052
16511991613,2cyclictest414-21kworker/u8:107:56:041
16511991613,2cyclictest30615-21kworker/u8:211:44:041
16511991613,2cyclictest26982-21kworker/u8:008:18:041
16511991613,2cyclictest24603-21kworker/u8:010:11:041
16511991613,2cyclictest23229-21kworker/u8:008:52:041
16511991613,2cyclictest16538-21kworker/u8:210:05:041
16511991613,2cyclictest12968-21kworker/u8:108:56:041
16511991613,2cyclictest12968-21kworker/u8:108:43:041
16511991613,2cyclictest12968-21kworker/u8:108:27:041
16510991613,2cyclictest414-21kworker/u8:108:04:010
16510991613,2cyclictest3565-21kworker/u8:010:23:040
16510991613,2cyclictest3565-21kworker/u8:010:23:040
16510991613,2cyclictest29203-21kworker/u8:209:20:050
16510991613,2cyclictest29203-21kworker/u8:209:09:040
16510991613,2cyclictest20159-21kworker/u8:210:44:040
16510991613,2cyclictest12968-21kworker/u8:108:44:040
16510991611,3cyclictest19576-21turbostat10:05:000
1651399151,3cyclictest17932-21ssh12:21:283
1651399151,3cyclictest16320-21memory10:35:163
1651399150,3cyclictest2514-21cat09:11:023
1651399150,3cyclictest0-21swapper/312:16:013
1651399150,13cyclictest0-21swapper/310:30:123
16512991512,2cyclictest22799-21kworker/u8:107:26:062
16512991512,2cyclictest16889-21kworker/u8:207:13:042
16512991512,2cyclictest16503-21kworker/u8:008:31:042
16512991512,2cyclictest12968-21kworker/u8:108:29:042
16512991512,2cyclictest12968-21kworker/u8:108:24:012
16512991510,3cyclictest0-21swapper/210:05:002
16511991512,2cyclictest8278-21kworker/u8:109:33:041
16511991512,2cyclictest5622-21kworker/u8:109:59:051
16511991512,2cyclictest30364-21kworker/u8:110:21:041
16511991512,2cyclictest30364-21kworker/u8:110:21:041
16511991512,2cyclictest26902-21kworker/u8:009:46:051
16511991512,2cyclictest12968-21kworker/u8:108:46:041
16511991512,2cyclictest12324-21kworker/u8:212:17:041
16511991512,2cyclictest10020-21kworker/u8:111:39:041
16511991512,2cyclictest0-21swapper/112:21:291
1651199151,12cyclictest30123-21fschecks_time12:35:151
16511991510,3cyclictest2406-21iostat_ios10:55:161
16511991510,3cyclictest0-21swapper/109:20:141
1651199150,13cyclictest0-21swapper/110:15:151
1651199150,13cyclictest0-21swapper/108:10:061
16510991512,2cyclictest8278-21kworker/u8:109:29:040
16510991512,2cyclictest26982-21kworker/u8:007:38:040
16510991512,2cyclictest24261-21kworker/u8:212:35:050
16510991512,2cyclictest16889-21kworker/u8:207:16:050
16510991512,2cyclictest15246-21kworker/u8:012:25:040
16510991512,2cyclictest10020-21kworker/u8:111:45:050
248642140,2sleep00-21swapper/012:30:090
226272140,2sleep20-21swapper/210:41:532
16513991411,2cyclictest0-21swapper/311:45:103
16513991411,2cyclictest0-21swapper/310:11:023
16513991410,2cyclictest0-21swapper/312:40:003
1651399140,3cyclictest5464-21ssh10:24:243
1651399140,3cyclictest5464-21ssh10:24:243
1651399140,3cyclictest22764-21latency_hist07:25:003
1651399140,2cyclictest5252-21diskstats08:00:123
1651399140,12cyclictest0-21swapper/312:25:143
1651399140,12cyclictest0-21swapper/311:40:163
1651399140,12cyclictest0-21swapper/310:16:543
1651399140,12cyclictest0-21swapper/309:47:273
16512991411,2cyclictest414-21kworker/u8:108:05:042
16512991411,2cyclictest18591-21kworker/u8:208:35:042
16512991411,2cyclictest10020-21kworker/u8:111:46:042
1651199142,7cyclictest0-21swapper/109:42:011
1651199141,3cyclictest28851-40update-apt-xapi07:40:081
16511991411,2cyclictest30671-21kworker/u8:207:47:041
16511991411,2cyclictest26982-21kworker/u8:007:36:051
16511991411,2cyclictest22799-21kworker/u8:107:29:041
16511991411,2cyclictest18591-21kworker/u8:208:33:041
16511991411,2cyclictest16889-21kworker/u8:207:31:041
16511991411,2cyclictest15246-21kworker/u8:012:28:041
16511991411,2cyclictest15246-21kworker/u8:011:53:041
16511991411,2cyclictest12968-21kworker/u8:108:21:041
16511991411,2cyclictest10210-21kworker/u8:211:16:041
16511991411,2cyclictest10020-21kworker/u8:111:47:041
16511991411,2cyclictest0-21swapper/110:30:491
1651199140,9cyclictest0-21swapper/107:10:041
1651199140,2cyclictest0-21swapper/111:04:041
1651199140,12cyclictest0-21swapper/110:52:581
1651199140,12cyclictest0-21swapper/110:26:011
16510991411,2cyclictest414-21kworker/u8:107:59:040
16510991411,2cyclictest12968-21kworker/u8:108:25:040
16510991411,2cyclictest0-21swapper/011:24:140
16510991411,2cyclictest0-21swapper/010:05:120
1651099140,3cyclictest0-21swapper/008:21:000
1651099140,2cyclictest0-21swapper/009:56:530
1651099140,2cyclictest0-21swapper/009:40:130
1651099140,2cyclictest0-21swapper/008:10:040
1651099140,13cyclictest0-21swapper/010:25:130
1651099140,12cyclictest0-21swapper/009:49:090
1651099140,12cyclictest0-21swapper/009:35:110
7372130,2sleep20-21swapper/211:28:542
16513991310,2cyclictest0-21swapper/312:12:343
16513991310,2cyclictest0-21swapper/311:51:243
16513991310,2cyclictest0-21swapper/311:01:463
16513991310,2cyclictest0-21swapper/310:48:363
16513991310,2cyclictest0-21swapper/310:43:233
16513991310,2cyclictest0-21swapper/309:58:373
16513991310,2cyclictest0-21swapper/309:32:463
16513991310,2cyclictest0-21swapper/307:40:053
16513991310,2cyclictest0-21swapper/307:30:163
1651399130,2cyclictest27796-21munin-node3
1651399130,2cyclictest0-21swapper/312:00:123
1651399130,2cyclictest0-21swapper/311:05:153
1651399130,2cyclictest0-21swapper/310:00:483
1651399130,1cyclictest0-21swapper/309:21:023
1651399130,12cyclictest0-21swapper/311:30:543
1651399130,11cyclictest0-21swapper/312:32:343
1651399130,11cyclictest0-21swapper/310:50:463
1651299131,10cyclictest9617-21rm09:53:502
1651299130,4cyclictest0-21swapper/212:20:022
1651299130,2cyclictest24038-21ssh12:29:042
1651299130,2cyclictest0-21swapper/212:06:032
1651299130,2cyclictest0-21swapper/210:58:042
1651299130,2cyclictest0-21swapper/207:33:042
1651299130,12cyclictest0-21swapper/212:15:302
1651299130,12cyclictest0-21swapper/211:10:122
1651299130,12cyclictest0-21swapper/209:10:142
1651199139,2cyclictest0-21swapper/109:16:461
1651199138,3cyclictest207150irq/24-eth110:40:131
1651199138,3cyclictest0-21swapper/108:05:131
1651199132,6cyclictest0-21swapper/111:30:001
16511991310,2cyclictest27385-21kworker/u8:010:49:041
16511991310,2cyclictest18591-21kworker/u8:208:39:041
1651199130,2cyclictest469-21diskmemload11:22:511
1651199130,12cyclictest0-21swapper/112:12:191
16510991310,2cyclictest16889-21kworker/u8:207:25:040
16510991310,2cyclictest0-21swapper/012:15:170
16510991310,2cyclictest0-21swapper/010:14:470
16510991310,2cyclictest0-21swapper/009:50:330
16510991310,2cyclictest0-21swapper/009:12:320
16510991310,2cyclictest0-21swapper/007:10:150
1651099130,2cyclictest0-21swapper/011:42:230
1651099130,2cyclictest0-21swapper/009:17:530
1651099130,2cyclictest0-21swapper/008:06:050
1651099130,12cyclictest0-21swapper/011:35:330
1651399129,2cyclictest0-21swapper/311:38:063
1651399129,2cyclictest0-21swapper/310:05:283
1651399129,2cyclictest0-21swapper/309:35:163
1651399129,2cyclictest0-21swapper/307:36:063
1651399129,2cyclictest0-21swapper/307:25:173
1651399122,5cyclictest0-21swapper/308:00:003
1651399121,6cyclictest0-21swapper/308:40:003
1651399121,6cyclictest0-21swapper/308:20:003
1651399120,2cyclictest0-21swapper/312:07:243
1651399120,2cyclictest0-21swapper/311:23:163
1651399120,2cyclictest0-21swapper/309:50:583
1651399120,2cyclictest0-21swapper/309:41:193
1651399120,2cyclictest0-21swapper/308:30:133
1651399120,1cyclictest0-21swapper/309:15:123
1651399120,11cyclictest0-21swapper/311:26:253
1651399120,11cyclictest0-21swapper/310:55:063
1651399120,11cyclictest0-21swapper/310:25:083
1651399120,11cyclictest0-21swapper/309:26:153
1651399120,11cyclictest0-21swapper/308:11:033
1651399120,11cyclictest0-21swapper/307:20:003
1651299129,2cyclictest26982-21kworker/u8:007:39:042
1651299129,2cyclictest0-21swapper/209:59:442
1651299129,2cyclictest0-21swapper/209:46:472
1651299129,2cyclictest0-21swapper/207:40:142
1651299128,2cyclictest469-21diskmemload11:25:002
1651299120,2cyclictest0-21swapper/212:00:042
1651299120,2cyclictest0-21swapper/211:15:042
1651299120,2cyclictest0-21swapper/210:30:192
1651299120,11cyclictest0-21swapper/209:29:092
1651299120,11cyclictest0-21swapper/207:20:122
1651199129,2cyclictest26982-21kworker/u8:007:53:041
1651199129,2cyclictest0-21swapper/111:06:121
1651199129,2cyclictest0-21swapper/109:35:201
1651199128,2cyclictest0-21swapper/110:35:101
1651199127,3cyclictest20622-21latency_hist07:20:001
1651199121,9cyclictest29137-21apt-get09:00:101
1651199120,3cyclictest0-21swapper/109:05:161
1651199120,2cyclictest0-21swapper/109:51:101
1651199120,11cyclictest0-21swapper/112:07:221
1651199120,11cyclictest0-21swapper/110:02:001
1651099129,2cyclictest0-21swapper/010:50:130
1651099120,2cyclictest20610-21copy07:20:040
1651099120,2cyclictest0-21swapper/010:32:450
1651099120,11cyclictest0-21swapper/011:07:400
1651399118,2cyclictest0-21swapper/307:10:153
1651399112,5cyclictest0-21swapper/307:55:003
1651299118,2cyclictest30671-21kworker/u8:207:46:042
1651299118,2cyclictest0-21swapper/209:23:252
1651299118,2cyclictest0-21swapper/208:55:152
1651299118,2cyclictest0-21swapper/207:55:012
1651299110,2cyclictest0-21swapper/211:41:042
1651299110,2cyclictest0-21swapper/211:36:042
1651299110,2cyclictest0-21swapper/210:23:152
1651299110,2cyclictest0-21swapper/210:23:142
1651299110,10cyclictest0-21swapper/209:41:262
1651299110,10cyclictest0-21swapper/209:36:152
1651199110,9cyclictest0-21swapper/108:00:121
1651099118,2cyclictest0-21swapper/008:31:030
200212100,2sleep00-21swapper/008:35:300
1651399101,5cyclictest0-21swapper/307:50:003
1651299100,9cyclictest0-21swapper/207:16:042
165139994,3cyclictest250902sleep308:50:063
165139994,3cyclictest15278-21cut08:25:133
165139993,4cyclictest31997-21head09:05:183
165139992,5cyclictest0-21swapper/308:20:583
165129996,2cyclictest2669-21apt-get07:55:122
165129990,8cyclictest0-21swapper/209:06:052
165109995,2cyclictest25548-21fschecks_count08:50:130
165139981,6cyclictest0-21swapper/308:45:593
165109983,3cyclictest27404-21cpuspeed_turbos08:55:130
165109980,2cyclictest0-21swapper/007:45:380
165129972,3cyclictest0-21swapper/208:50:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional