You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 23:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Jun 24, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2148502996962,5cyclictest2372832-21kworker/u8:1+events_unbound12:30:351
2148502996759,5cyclictest2153008-21kworker/u8:2+flush-8:007:25:351
2148502996354,6cyclictest2096357-21kworker/u8:1+events_unbound08:10:331
2148502995952,5cyclictest2363986-21kworker/u8:0+flush-8:011:00:281
2148502995952,5cyclictest2363986-21kworker/u8:0+flush-8:011:00:271
2148502995651,3cyclictest2274011-21kworker/u8:0+events_unbound10:15:011
2148499995645,8cyclictest2397520-21ntpq11:15:290
23521982540,5chrt0-21swapper/110:30:261
2148502995449,4cyclictest2363986-21kworker/u8:0+events_unbound11:00:001
2148502995449,4cyclictest2363986-21kworker/u8:0+events_unbound10:59:591
2148502995449,3cyclictest2383834-21kworker/u8:3+events_unbound11:35:341
2148502995444,7cyclictest2159284-21ntpq07:15:291
2148499995432,8cyclictest2334484-21diskstats10:15:190
2148502995347,4cyclictest2096988-21kworker/u8:4+events_unbound07:35:331
2148502995346,5cyclictest2096357-21kworker/u8:1+events_unbound08:50:211
22689302520,3chrt0-21swapper/209:05:352
2148502995245,5cyclictest2274011-21kworker/u8:0+flush-8:009:45:301
2148502995245,5cyclictest2096988-21kworker/u8:4+flush-8:010:20:331
2148502995146,4cyclictest2224760-21kworker/u8:0+events_unbound08:35:221
2148502995146,4cyclictest2096357-21kworker/u8:1+events_unbound07:20:331
2148502995145,4cyclictest2313841-21kworker/u8:2+flush-8:010:45:211
2148502995145,4cyclictest2096357-21kworker/u8:1+events_unbound07:30:281
2148502995145,3cyclictest2096357-21kworker/u8:1+events_unbound08:45:001
2148502995045,4cyclictest2405505-21kworker/u8:0+flush-8:012:10:311
2148502995044,4cyclictest2467477-21kworker/u8:2+flush-8:012:35:321
2148502995044,4cyclictest2096988-21kworker/u8:4+events_unbound09:40:251
2148502994945,3cyclictest2096357-21kworker/u8:1+flush-8:009:10:321
2148502994944,3cyclictest2254591-21kworker/u8:2+events_unbound09:00:211
2148502994942,5cyclictest1704890-21systemd-journal12:30:001
2148502994844,3cyclictest2372832-21kworker/u8:1+events_unbound11:25:001
2148502994841,5cyclictest2344552-21kworker/u8:0+events_unbound10:35:341
2148502994841,5cyclictest2274011-21kworker/u8:0+events_unbound09:35:361
2148502994841,5cyclictest2153008-21kworker/u8:2+flush-8:007:55:211
2148499994842,4cyclictest2096357-21kworker/u8:1+flush-8:007:20:000
2148502994741,5cyclictest2096988-21kworker/u8:4+events_unbound10:00:351
2148502994741,4cyclictest2383834-21kworker/u8:3+events_unbound11:40:331
2148502994741,4cyclictest2372832-21kworker/u8:1+events_unbound11:50:321
2148502994641,3cyclictest2096988-21kworker/u8:4+events_unbound10:40:221
2148502994639,5cyclictest2254591-21kworker/u8:2+flush-8:009:05:301
2148502994639,5cyclictest2096988-21kworker/u8:4+events_unbound09:15:191
2148502994636,8cyclictest1704890-21systemd-journal12:07:461
24575162450,2sleep0201rcuc/012:15:360
2148502994539,4cyclictest2096357-21kworker/u8:1+flush-8:008:55:201
2148502994537,6cyclictest2372832-21kworker/u8:1+events_unbound10:50:321
2148502994536,7cyclictest2457156-21ntpq12:15:301
2148499994534,8cyclictest2328114-21ntpq10:05:300
2148502994439,3cyclictest2153008-21kworker/u8:2+events_unbound07:45:321
2148502994437,5cyclictest2383834-21kworker/u8:3+flush-8:012:00:311
2148502994339,3cyclictest2096357-21kworker/u8:1+flush-8:008:45:211
2148502994337,4cyclictest2096988-21kworker/u8:4+events_unbound07:40:211
2148502994335,7cyclictest2383834-21kworker/u8:3+flush-8:011:25:321
2148502994237,3cyclictest2293199-21ntpq09:30:281
2148502994236,5cyclictest2096357-21kworker/u8:1+events_unbound08:20:301
2148502994236,4cyclictest2344552-21kworker/u8:0+events_unbound10:25:331
2148502994236,4cyclictest2274011-21kworker/u8:0+flush-8:010:05:201
2148499994233,6cyclictest1704890-21systemd-journal07:15:000
2148499994232,8cyclictest2238792-21ntpq08:35:290
2148502994136,3cyclictest2304296-21kworker/u8:1+events_unbound09:50:191
2148502994135,4cyclictest2313841-21kworker/u8:2+events_unbound11:05:191
2148502994134,5cyclictest1704890-21systemd-journal08:17:551
2148502994033,5cyclictest2437427-21ntpq11:55:291
2148502994033,5cyclictest2383834-21kworker/u8:3+flush-8:011:45:331
2148502994033,5cyclictest2111658-21kworker/u8:0+flush-8:007:10:211
2148502993934,4cyclictest2405505-21kworker/u8:0+flush-8:011:30:311
2148502993929,8cyclictest2228862-21ntpq08:25:301
2148502993833,3cyclictest2096988-21kworker/u8:4+events_unbound08:30:211
2148502993830,6cyclictest2204986-21latency_hist08:05:011
2148499993826,9cyclictest1704890-21systemd-journal11:02:480
2148499993826,9cyclictest1704890-21systemd-journal11:02:470
2148504993734,2cyclictest2153008-21kworker/u8:2+events_unbound08:05:592
2148502993733,3cyclictest2313841-21kworker/u8:2+events_unbound11:15:291
2148502993732,4cyclictest2096988-21kworker/u8:4+flush-8:009:55:361
2148502993732,3cyclictest2405505-21kworker/u8:0+flush-8:012:20:251
2148502993732,3cyclictest2274011-21kworker/u8:0+events_unbound10:15:271
2148499993732,4cyclictest2096988-21kworker/u8:4+flush-8:008:55:360
2148499993727,7cyclictest1704890-21systemd-journal07:35:000
2148502993632,3cyclictest2372832-21kworker/u8:1+flush-8:011:10:261
2148499993628,5cyclictest2185258-21latency_hist07:45:020
214849999360,30cyclictest2138541-21kworker/0:1+events10:55:000
2148499993526,7cyclictest2210184-21/usr/sbin/munin08:10:310
214849999352,31cyclictest2138541-21kworker/0:1+events08:18:430
2148504993430,3cyclictest2153008-21kworker/u8:2+events_unbound07:10:412
2148499993423,9cyclictest2422258-21ntpq11:40:300
22348562330,2sleep2371rcuc/208:35:012
2148502993328,4cyclictest2096988-21kworker/u8:4+flush-8:009:20:371
2148499993328,3cyclictest2224792-21idleruntime-cro08:24:590
2148499993326,5cyclictest2372832-21kworker/u8:1+flush-8:011:56:190
2148499993326,5cyclictest1704890-21systemd-journal11:08:290
2148499993325,6cyclictest2096357-21kworker/u8:1+flush-8:007:20:300
214849999332,30cyclictest2138541-21kworker/0:1+events09:43:190
214849999332,26cyclictest2138541-21kworker/0:1+events10:35:180
23956452320,5sleep2371rcuc/211:15:262
2148502993228,3cyclictest2153008-21kworker/u8:2+events_unbound08:05:331
2148502993224,6cyclictest2289204-21latency_hist09:30:011
2148499993228,3cyclictest2206177-21kthreadcore08:05:240
2148499993227,3cyclictest2368318-21grep10:45:370
2148499993224,5cyclictest2319122-21latency_hist10:00:010
2148499993210,20cyclictest2138541-21kworker/0:1+events11:50:200
2148504993125,4cyclictest2274011-21kworker/u8:0+flush-8:010:00:312
2148504993124,4cyclictest1704890-21systemd-journal09:54:592
2148499993124,5cyclictest1704890-21systemd-journal12:29:470
214849999312,27cyclictest2138541-21kworker/0:1+events11:45:160
2148499993120,9cyclictest2185772-21diskstats07:45:210
214849999311,28cyclictest2138541-21kworker/0:1+events11:10:310
214849999311,28cyclictest2138541-21kworker/0:1+events10:20:290
2148499993111,12cyclictest2138541-21kworker/0:1+events11:30:150
2148504993025,3cyclictest2463526-21cpuspeed_turbos12:25:182
2148504993021,7cyclictest1704890-21systemd-journal11:40:002
214850499300,5cyclictest2324669-21seq10:05:202
2148499993022,5cyclictest2378657-21latency_hist11:00:010
2148499993022,5cyclictest2378657-21latency_hist11:00:010
214849999301,27cyclictest2138541-21kworker/0:1+events09:00:210
2148499993011,17cyclictest2138541-21kworker/0:1+events11:40:010
2148499993011,14cyclictest2138541-21kworker/0:1+events08:00:140
214849999300,28cyclictest2138541-21kworker/0:1+events08:30:310
2148502992926,2cyclictest2153008-21kworker/u8:2+events_unbound07:50:181
214849999299,18cyclictest2138541-21kworker/0:1+events08:25:270
2148499992924,3cyclictest2279328-21systemd-run09:20:010
214849999292,26cyclictest2138541-21kworker/0:1+events12:10:330
214849999292,25cyclictest2138541-21kworker/0:1+events10:40:250
214849999291,27cyclictest2138541-21kworker/0:1+events08:40:310
214849999291,26cyclictest2138541-21kworker/0:1+events07:55:350
2148504992824,2cyclictest2349166-21aten2_r5power_e10:30:182
2148504992824,2cyclictest2329361-21aten2_r5power_e10:10:202
2148504992818,8cyclictest2453113-21awk12:15:002
2148499992824,3cyclictest2268926-21grep09:05:350
2148499992823,3cyclictest2408378-21idleruntime-cro11:30:010
214849999281,26cyclictest2138541-21kworker/0:1+events08:46:030
214849999281,26cyclictest2138541-21kworker/0:1+events07:35:290
2148499992811,16cyclictest2138541-21kworker/0:1+events09:25:340
2148499992811,15cyclictest2138541-21kworker/0:1+events10:30:210
2148499992810,16cyclictest2138541-21kworker/0:1+events09:45:280
24476122270,6sleep20-21swapper/212:05:392
2148504992722,3cyclictest2244273-21unixbench_multi08:40:382
2148504992717,8cyclictest1704890-21systemd-journal08:16:472
214849999279,16cyclictest2138541-21kworker/0:1+events09:10:280
214849999278,15cyclictest2138541-21kworker/0:1+events12:00:250
214849999278,13cyclictest2329307-21taskset10:10:190
214849999276,16cyclictest2472961-21kworker/0:1+events12:35:160
214849999273,22cyclictest2138541-21kworker/0:1+events07:50:310
2148499992721,4cyclictest2299070-21apt-get09:40:010
2148499992710,15cyclictest2138541-21kworker/0:1+events10:25:290
214850499264,6cyclictest39-21ksoftirqd/208:55:352
2148504992622,2cyclictest2418647-21aten2_r5power_p11:40:192
2148504992622,2cyclictest2404018-21fschecks_time11:25:212
2148504992622,2cyclictest2334549-21fschecks_time10:15:212
2148504992622,2cyclictest2289777-21fschecks_time09:30:202
214849999268,16cyclictest2138541-21kworker/0:1+events12:05:240
214849999266,18cyclictest2138541-21kworker/0:1+events09:50:370
214849999266,18cyclictest2138541-21kworker/0:1+events09:22:370
214850499254,5cyclictest2158292-21cut07:15:272
214850499252,5cyclictest0-21swapper/209:35:212
2148504992519,4cyclictest2408998-21fschecks_time11:30:212
2148499992518,4cyclictest0-21swapper/012:30:170
2148499992516,7cyclictest2319386-21/usr/sbin/munin10:00:280
22332352240,3sleep3471rcuc/308:30:283
214850499247,8cyclictest0-21swapper/207:35:232
214850499246,3cyclictest0-21swapper/208:25:332
214850499243,6cyclictest39-21ksoftirqd/209:55:242
214850499243,2cyclictest0-21swapper/212:31:212
214850499242,4cyclictest0-21swapper/210:45:252
214850499242,4cyclictest0-21swapper/210:25:232
2148504992420,2cyclictest2423997-21fschecks_count11:45:212
2148504992415,7cyclictest2363766-21awk10:44:592
2148504992415,7cyclictest1704890-21systemd-journal07:55:002
214850499240,8cyclictest2198721-21cut07:55:272
214850499240,6cyclictest2203407-21kthreadcore08:00:242
214850499240,6cyclictest2180614-21cut07:40:192
214850499240,14cyclictest2476412-21tr12:35:272
214850499240,14cyclictest2436611-21kthreadcore11:55:242
214850499240,10cyclictest2224313-21grep08:20:372
214849999248,14cyclictest2138541-21kworker/0:1+events09:30:160
214849999247,16cyclictest2453144-21kworker/0:2+events12:20:180
214849999247,16cyclictest2138541-21kworker/0:1+events11:20:270
214849999246,16cyclictest2138541-21kworker/0:1+events07:25:290
214850499235,5cyclictest0-21swapper/211:20:252
214850499234,4cyclictest0-21swapper/209:45:242
214850499232,5cyclictest0-21swapper/210:50:262
214850499232,4cyclictest0-21swapper/207:25:352
2148504992320,2cyclictest2210267-21aten2_r5power_e08:10:202
2148504992319,3cyclictest2463032-21cron12:25:012
2148504992319,2cyclictest371rcuc/210:20:222
2148504992318,4cyclictest2433350-21awk11:55:012
2148504992314,1cyclictest161rcu_preempt12:05:012
214850499230,7cyclictest2390388-21grep11:10:262
214850499230,5cyclictest2245300-21fschecks_time08:45:202
214849999235,16cyclictest2138541-21kworker/0:1+events08:50:210
214850499222,7cyclictest0-21swapper/208:39:042
214850499222,5cyclictest0-21swapper/209:40:282
214850499222,5cyclictest0-21swapper/207:20:182
2148504992216,4cyclictest2279279-21idleruntime-cro09:19:592
214850499220,8cyclictest2262130-21tr09:00:262
214850499220,6cyclictest2249897-21apt-get08:50:182
214850499220,5cyclictest2269647-21apt-get09:10:192
214850499220,5cyclictest2185812-21sort07:45:232
214850499220,4cyclictest2456894-21kthreadcore12:15:272
21480072226,10sleep10-21swapper/107:06:241
214850499212,6cyclictest0-21swapper/211:06:042
214850499212,5cyclictest0-21swapper/209:25:232
214850499212,4cyclictest0-21swapper/210:55:052
214850499212,4cyclictest0-21swapper/210:55:042
214850499210,12cyclictest2171114-21irqcore07:30:232
214850499204,3cyclictest0-21swapper/210:35:332
214850499192,7cyclictest0-21swapper/209:20:282
214850499192,4cyclictest0-21swapper/211:00:212
214850499192,4cyclictest0-21swapper/211:00:202
214849999192,13cyclictest2148299-21latency_hist07:10:020
21439282183,8sleep30-21swapper/307:05:203
21436572184,10sleep20-21swapper/207:05:162
23443682170,2sleep3471rcuc/310:25:183
22696502162,9sleep30-21swapper/309:10:193
24633152143,7sleep30-21swapper/312:25:193
22620772140,2sleep3481ktimers/309:00:263
22545882142,6sleep30-21swapper/308:55:023
24769802132,7sleep30-21swapper/312:35:303
23934832131,8sleep30-21swapper/311:15:003
23630852132,7sleep30-21swapper/310:40:363
23044962132,6sleep30-21swapper/309:45:023
22990522132,7sleep30-21swapper/309:40:003
22793832132,6sleep30-21swapper/309:20:013
22437782132,7sleep30-21swapper/308:40:333
22199332132,6sleep30-21swapper/308:20:023
21810812132,7sleep30-21swapper/307:40:253
24587272122,6sleep30-21swapper/312:20:213
24482182121,6sleep30-21swapper/312:10:023
24478342122,6sleep30-21swapper/312:05:413
24190162122,6sleep30-21swapper/311:40:233
24135902122,6sleep30-21swapper/311:35:193
24083682121,7sleep30-21swapper/311:30:003
24023592122,6sleep30-21swapper/311:20:303
23876812122,6sleep30-21swapper/311:05:323
23737432122,6sleep30-21swapper/310:55:013
23737432122,6sleep30-21swapper/310:55:003
23694932122,6sleep30-21swapper/310:50:243
23651272122,6sleep30-21swapper/310:45:253
23389992122,5sleep30-21swapper/310:20:023
23295522123,5sleep30-21swapper/310:10:223
23233292122,6sleep30-21swapper/310:00:353
23141912122,5sleep30-21swapper/309:55:023
23095862122,6sleep30-21swapper/309:50:193
23020232122,6sleep30-21swapper/309:40:293
22883802122,6sleep30-21swapper/309:25:363
22524152122,6sleep30-21swapper/308:50:283
22487192122,6sleep30-21swapper/308:45:303
22365892123,5sleep30-21swapper/308:35:273
22254682122,6sleep30-21swapper/308:25:233
22151152122,6sleep30-21swapper/308:15:173
22104512122,6sleep30-21swapper/308:10:223
22088682122,6sleep30-21swapper/308:05:293
21951222122,6sleep30-21swapper/307:55:013
21945062122,6sleep30-21swapper/307:50:373
21701602122,5sleep30-21swapper/307:30:023
21654512122,6sleep30-21swapper/307:25:163
21608982122,6sleep30-21swapper/307:20:223
21533452122,6sleep30-21swapper/307:15:013
24682412112,6sleep30-21swapper/312:30:163
24580522112,5sleep30-21swapper/312:20:003
24385472112,5sleep30-21swapper/312:00:033
24336212112,5sleep30-21swapper/311:55:163
24287202112,5sleep30-21swapper/311:50:203
24232182111,5sleep30-21swapper/311:45:023
24095662112,5sleep30-21swapper/311:30:253
23977022111,6sleep30-21swapper/311:15:363
23829452112,5sleep30-21swapper/311:00:353
23829452112,5sleep30-21swapper/311:00:353
23549782112,5sleep30-21swapper/310:35:273
23488262112,5sleep30-21swapper/310:30:013
23342092112,5sleep30-21swapper/310:15:163
22891942111,5sleep30-21swapper/309:30:013
22748442112,5sleep30-21swapper/309:15:203
22647102112,5sleep30-21swapper/309:05:163
22040492112,6sleep30-21swapper/308:00:283
21854772112,5sleep30-21swapper/307:45:033
21793872112,5sleep30-21swapper/307:35:313
23243102102,5sleep30-21swapper/310:05:093
21560482102,5sleep30-21swapper/307:15:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional