You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 20:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Jan 03, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2405466995750,5cyclictest2447258-21kworker/u8:1+events_unbound09:20:373
2405463995039,7cyclictest2464810-21sendmail10:00:002
2405466994841,5cyclictest2419519-21kworker/u8:0+events_unbound08:10:193
2405466994739,4cyclictest0-21swapper/309:45:163
2405458994738,6cyclictest2471196-21grep10:15:241
2405453994711,4cyclictest131rcu_preempt09:15:120
2405466994538,4cyclictest2437194-21munin-plugin-st08:40:003
2405466994538,4cyclictest2437194-21munin-plugin-st08:40:003
2405463994518,4cyclictest2447007-21grep09:05:232
240545899453,9cyclictest2500765-21cron11:43:001
2405458994535,6cyclictest2497109-21unixbench_singl11:30:271
2405458994532,9cyclictest2514217-21grep12:20:231
2405463994335,4cyclictest2476965-21cron10:35:012
2405458994332,7cyclictest2447028-21grep09:05:231
2405458994321,19cyclictest0-21swapper/109:00:011
240545899431,9cyclictest2437555-21/usr/sbin/munin08:40:151
240545899431,9cyclictest2437555-21/usr/sbin/munin08:40:151
2405466994235,4cyclictest0-21swapper/311:20:003
2405463994234,5cyclictest68-21kswapd008:20:062
2405463994219,4cyclictest0-21swapper/208:20:012
2405458994234,5cyclictest2509492-21idleruntime-cro12:10:001
2405458994234,5cyclictest2509492-21idleruntime-cro12:09:591
2405458994223,15cyclictest0-21swapper/111:10:001
240545899421,9cyclictest2405952-21/usr/sbin/munin07:10:181
2405458994218,20cyclictest0-21swapper/109:35:271
2405458994213,24cyclictest0-21swapper/107:50:151
2405458994212,26cyclictest0-21swapper/107:15:261
2405453994231,7cyclictest2431433-21sshd08:20:260
2405453994230,8cyclictest2457934-21cron09:40:000
240545399422,7cyclictest131rcu_preempt11:25:120
2405466994129,8cyclictest2478702-21sendmail10:40:013
2405466994127,10cyclictest391ktimers/312:10:133
2405466994127,10cyclictest391ktimers/312:10:133
240546699411,9cyclictest0-21swapper/309:05:113
2405463994115,7cyclictest2491910-21grep11:15:242
240545899411,11cyclictest2491958-21head11:15:241
240545899411,10cyclictest2518662-21cut12:35:171
2405453994127,9cyclictest2485547-21sendmail11:00:010
2405463994029,8cyclictest438-21cron07:25:012
240545899401,9cyclictest2506303-21/usr/sbin/munin12:00:181
240545899401,9cyclictest2502994-21/usr/sbin/munin11:50:151
240545899401,8cyclictest2493394-21/usr/sbin/munin11:20:231
240545899401,8cyclictest2417219-21/usr/sbin/munin07:40:231
240545899401,11cyclictest2418317-21diskstats07:45:151
2405466993933,4cyclictest2497462-21kworker/u8:1+events_unbound11:40:593
2405466993928,8cyclictest391ktimers/311:10:113
2405463993931,4cyclictest0-21swapper/211:00:012
2405463993930,5cyclictest2419248-21unixbench_singl07:45:252
2405458993932,4cyclictest2473365-21munin-plugin-st10:25:001
2405458993927,8cyclictest2451122-21sendmail09:20:001
240545899391,9cyclictest2423539-21fschecks_time08:00:161
240545899391,7cyclictest2476278-21/usr/sbin/munin10:30:251
2405458993914,22cyclictest0-21swapper/111:10:211
2405458993912,24cyclictest0-21swapper/107:35:291
240545899391,11cyclictest2444734-21meminfo09:00:191
240545899391,10cyclictest2498082-21/usr/sbin/munin11:35:181
240545899391,10cyclictest2482799-21memory10:50:211
2405466993830,4cyclictest0-21swapper/312:16:043
2405466993826,8cyclictest2448713-21grep09:10:293
2405463993828,6cyclictest0-21swapper/209:15:282
240545899382,5cyclictest2435261-21cron08:35:001
240545899382,10cyclictest2459661-21cron09:45:001
240545899381,9cyclictest2468453-21/usr/sbin/munin10:10:131
240545899381,8cyclictest2455158-21/usr/sbin/munin09:30:191
240545899381,7cyclictest2486118-21/usr/sbin/munin11:00:191
240545899381,5cyclictest2484048-21/usr/sbin/munin10:55:161
2405458993811,24cyclictest2461435-21latency_hist09:50:011
2405458993811,24cyclictest0-21swapper/108:35:061
2405458993811,24cyclictest0-21swapper/108:35:061
240545899381,10cyclictest2475264-21cron10:30:011
2405453993830,6cyclictest2485208-21kworker/u8:3+events_unbound11:30:560
240545899379,24cyclictest0-21swapper/108:15:251
240545899378,5cyclictest2410739-21seq07:20:291
240545899377,7cyclictest2516009-21seq12:26:111
2405458993729,4cyclictest0-21swapper/110:05:001
240545899372,5cyclictest2512926-21sendmail-msp12:20:001
240545899372,5cyclictest2427198-21meminfo08:10:201
240545899372,5cyclictest2413059-21/usr/sbin/munin07:30:121
240545899372,5cyclictest2413059-21/usr/sbin/munin07:30:121
2405458993725,8cyclictest2452353-21grep09:20:241
240545899371,9cyclictest2516889-21diskstats12:30:151
240545899371,9cyclictest2477309-21df10:35:121
240545899371,9cyclictest2464641-21sshd09:58:201
240545899371,9cyclictest2449077-21taskset09:13:541
240545899371,8cyclictest2467312-21/usr/sbin/munin10:05:221
240545899371,7cyclictest2411519-21fschecks_count07:25:171
240545899371,6cyclictest2501354-21fschecks_time11:45:161
240545899371,10cyclictest2462654-21grep09:50:281
2405466993630,4cyclictest2447258-21kworker/u8:1+events_unbound09:27:413
2405466993628,6cyclictest2473214-21kworker/u8:0+events_unbound10:25:413
2405466993617,5cyclictest2512873-21kworker/u8:1+events_unbound12:26:223
2405463993630,4cyclictest2454528-21sh09:30:002
2405463993625,7cyclictest2519488-21grep12:35:262
240545899363,7cyclictest2422196-21/usr/sbin/munin07:55:231
240545899361,9cyclictest2510742-21grep12:10:251
240545899361,9cyclictest2510742-21grep12:10:251
240545899361,9cyclictest2430504-21diskstats08:20:161
240545899361,7cyclictest2494323-21/usr/sbin/munin11:25:141
240545899361,7cyclictest2454384-21taskset09:28:201
240545899361,7cyclictest2440859-21/usr/sbin/munin08:50:141
240545899361,7cyclictest2440153-21grep08:45:261
240545899361,7cyclictest2425029-21/usr/sbin/munin08:05:241
240545899361,6cyclictest2505651-21grep11:55:241
240545899360,9cyclictest2433313-21sh08:27:001
2405453993629,4cyclictest2492402-21idleruntime-cro11:20:000
2405453993628,4cyclictest0-21swapper/011:45:570
2405453993627,5cyclictest208-21systemd-logind09:55:370
2405463993526,6cyclictest2469917-21cron10:15:002
2405463993526,4cyclictest0-21swapper/211:35:002
240545899353,4cyclictest0-21swapper/110:45:161
240545899351,11cyclictest2479270-21irqstats10:40:171
2405453993529,4cyclictest2478307-21kworker/u8:0+events_unbound10:50:440
2405453993528,5cyclictest2419663-21cron07:50:000
240545399352,4cyclictest131rcu_preempt10:40:120
2405463993427,3cyclictest0-21swapper/212:05:162
2405463993427,3cyclictest0-21swapper/212:05:162
2405463993424,7cyclictest2473559-21apt-key10:25:012
2405463993424,6cyclictest0-21swapper/207:35:292
2405453993428,4cyclictest2514848-21kworker/u8:0+events_unbound12:36:060
2405453993427,3cyclictest0-21swapper/007:20:010
2405453993426,4cyclictest0-21swapper/012:00:000
2405453993424,6cyclictest0-21swapper/007:55:260
2405466993316,5cyclictest2443746-21kworker/u8:0+events_unbound08:57:193
240546699331,29cyclictest2499218-21munin-run11:40:003
2405463993325,4cyclictest0-21swapper/211:00:262
2405463993321,7cyclictest2426050-21grep08:05:252
240545899331,6cyclictest2405459-21latency_hist07:10:011
2405453993322,6cyclictest2500931-21cron11:45:000
2405453993317,10cyclictest121ktimers/007:50:120
2405453993316,9cyclictest2504233-21kworker/u8:0+events_unbound11:54:090
240545399331,4cyclictest131rcu_preempt09:25:120
2405453993311,15cyclictest0-21swapper/007:40:200
2405466993226,4cyclictest2447258-21kworker/u8:1+events_unbound09:35:193
2405466993224,4cyclictest0-21swapper/312:35:153
2405463993225,4cyclictest0-21swapper/212:00:272
2405463993224,5cyclictest0-21swapper/209:00:012
2405463993222,6cyclictest0-21swapper/210:05:262
2405463993220,8cyclictest2420960-21grep07:50:262
2405453993225,5cyclictest2401874-21kworker/u8:1+events_unbound07:25:010
240545399321,5cyclictest131rcu_preempt07:25:140
2405466993124,4cyclictest0-21swapper/307:45:253
2405466993123,4cyclictest0-21swapper/308:40:163
2405466993123,4cyclictest0-21swapper/308:40:163
2405466993122,5cyclictest1-21systemd08:25:273
2405466993121,7cyclictest2463081-21cron09:55:003
2405466993112,5cyclictest2462923-21kworker/u8:2+events_unbound10:05:213
2405463993122,7cyclictest438-21cron12:35:002
2405463993121,7cyclictest2479996-21grep10:40:252
2405453993123,5cyclictest2488963-21munin-plugin-st11:10:000
2405453993123,4cyclictest0-21swapper/010:15:000
2405453993122,6cyclictest2440275-21kworker/u8:2+events_unbound08:55:300
2405453993120,6cyclictest0-21swapper/007:30:260
2405453993120,6cyclictest0-21swapper/007:30:260
2405466993024,4cyclictest2416028-21kworker/u8:0+events_unbound07:40:033
2405466993024,3cyclictest0-21swapper/310:50:273
2405466993023,4cyclictest0-21swapper/308:20:013
2405466993022,5cyclictest0-21swapper/311:45:253
2405466993019,7cyclictest2414100-21grep07:30:263
2405466993019,7cyclictest2414100-21grep07:30:263
2405463993023,4cyclictest0-21swapper/209:15:012
2405463993022,4cyclictest0-21swapper/208:00:172
2405453993024,4cyclictest2497462-21kworker/u8:1+events_unbound12:12:400
2405453993024,4cyclictest2497462-21kworker/u8:1+events_unbound12:12:400
2405453993022,4cyclictest0-21swapper/009:40:240
2405466992921,5cyclictest2509477-21cron12:10:003
2405466992921,5cyclictest2509477-21cron12:10:003
2405466992921,4cyclictest0-21swapper/311:00:263
2405466992920,7cyclictest2466162-21kworker/u8:3+events_unbound10:02:573
2405466992915,10cyclictest391ktimers/309:15:113
2405463992922,4cyclictest0-21swapper/210:45:162
2405463992921,4cyclictest0-21swapper/211:45:252
2405463992919,6cyclictest2441885-21grep08:50:302
2405463992919,6cyclictest2434807-21grep08:30:252
2405463992917,9cyclictest2478260-21grep10:35:232
2405453992922,5cyclictest2434929-21kworker/u8:1+events_unbound08:40:300
2405453992922,5cyclictest2434929-21kworker/u8:1+events_unbound08:40:300
2405453992922,3cyclictest0-21swapper/012:05:260
2405453992922,3cyclictest0-21swapper/012:05:260
2405453992917,9cyclictest121ktimers/009:30:120
2405466992822,3cyclictest0-21swapper/310:15:003
2405466992822,3cyclictest0-21swapper/307:50:123
2405466992821,3cyclictest0-21swapper/308:05:163
2405466992817,7cyclictest2434797-21grep08:30:253
2405463992821,5cyclictest2427801-21unixbench_singl08:10:262
2405463992820,4cyclictest0-21swapper/211:40:252
2405463992816,6cyclictest0-21swapper/210:25:272
2405453992823,3cyclictest13550irq/42-30be0000.ethernet08:10:190
2405453992821,3cyclictest0-21swapper/012:30:000
2405453992821,3cyclictest0-21swapper/008:15:220
2405453992819,6cyclictest2507151-21threads12:00:260
240546699279,4cyclictest131rcu_preempt11:30:203
2405466992721,3cyclictest0-21swapper/309:40:203
2405466992719,5cyclictest2421752-21fschecks_count07:55:173
2405466992718,7cyclictest2442001-21kworker/u8:1+events_unbound09:00:353
2405453992720,3cyclictest0-21swapper/010:05:260
2405453992720,3cyclictest0-21swapper/009:05:140
2405453992719,4cyclictest2452819-21apt09:25:000
2405453992719,4cyclictest0-21swapper/009:00:250
2405453992718,5cyclictest2466104-21grep10:00:270
240546699268,12cyclictest381rcuc/310:30:203
240546699263,11cyclictest2441783-21kworker/3:1-events11:55:273
2405466992619,5cyclictest2483513-21kworker/u8:2+events_unbound10:55:143
2405466992619,5cyclictest2389187-21kworker/u8:0+events_unbound07:17:553
2405466992618,5cyclictest2431433-21sshd08:20:263
240546699261,12cyclictest0-21swapper/309:58:203
240546699260,4cyclictest131rcu_preempt09:30:113
2405463992620,3cyclictest0-21swapper/208:35:152
2405463992620,3cyclictest0-21swapper/208:35:152
2405463992618,5cyclictest311ktimers/207:55:132
2405463992618,4cyclictest0-21swapper/207:20:012
2405463992616,5cyclictest0-21swapper/207:35:022
2405463992616,5cyclictest0-21swapper/207:35:022
240545399267,3cyclictest131rcu_preempt07:15:010
2405453992620,3cyclictest0-21swapper/009:50:280
2405453992618,4cyclictest0-21swapper/010:35:010
2405453992615,8cyclictest2481392-21sensors_temp10:45:230
2405466992519,4cyclictest2462923-21kworker/u8:2+events_unbound10:19:143
2405466992519,3cyclictest0-21swapper/310:25:003
2405466992518,5cyclictest2409388-21kworker/u8:3+events_unbound07:20:473
2405466992518,4cyclictest0-21swapper/307:30:013
240546699251,12cyclictest0-21swapper/311:20:593
2405463992518,4cyclictest0-21swapper/212:10:232
2405463992518,4cyclictest0-21swapper/212:10:232
2405463992518,4cyclictest0-21swapper/211:50:262
2405463992517,5cyclictest0-21swapper/210:50:272
2405463992517,4cyclictest0-21swapper/211:20:242
2405463992516,6cyclictest0-21swapper/212:25:262
2405463992516,5cyclictest2438460-21tail08:40:262
2405463992516,5cyclictest2438460-21tail08:40:262
2405453992517,6cyclictest2497462-21kworker/u8:1+events_unbound11:38:260
2405453992516,3cyclictest13550irq/42-30be0000.ethernet09:10:510
2405453992515,7cyclictest2436793-21grep08:35:270
2405453992515,7cyclictest2436793-21grep08:35:260
240545399251,20cyclictest0-21swapper/008:51:490
240545399251,13cyclictest0-21swapper/011:14:000
240546699247,4cyclictest2440275-21kworker/u8:2+events_unbound08:52:163
240546699246,10cyclictest131rcu_preempt11:05:273
2405466992416,4cyclictest0-21swapper/311:50:163
2405466992415,6cyclictest438-21cron08:50:003
240546699240,12cyclictest0-21swapper/310:40:183
2405463992417,4cyclictest0-21swapper/211:25:242
2405463992414,6cyclictest0-21swapper/209:45:252
2405453992417,3cyclictest0-21swapper/008:02:050
2405453992415,7cyclictest2434338-21ntpq08:30:200
240545399241,19cyclictest0-21swapper/012:19:470
240545399241,19cyclictest0-21swapper/011:04:510
240546699239,3cyclictest0-21swapper/312:00:223
2405466992317,4cyclictest2493983-21kworker/u8:1+events_unbound11:25:303
2405466992315,6cyclictest2478307-21kworker/u8:0+events_unbound10:46:323
240546399232,13cyclictest2505636-21grep11:55:242
2405463992316,3cyclictest0-21swapper/212:15:212
2405463992315,5cyclictest0-21swapper/211:05:262
2405463992315,3cyclictest0-21swapper/209:20:202
2405463992314,7cyclictest2455012-21basename09:30:172
2405463992313,6cyclictest2432323-21grep08:25:172
240545399233,4cyclictest131rcu_preempt10:25:130
240545399233,4cyclictest131rcu_preempt09:45:130
2405453992313,7cyclictest2513254-21df12:20:120
2405453992313,7cyclictest2439708-21cat08:45:210
2405453992313,7cyclictest2415027-21basename07:35:200
2405466992216,4cyclictest2414216-21kworker/u8:1+events_unbound08:03:003
2405466992214,5cyclictest0-21swapper/307:10:173
2405466992212,7cyclictest2517184-21sed12:30:183
2405463992216,4cyclictest311ktimers/207:10:122
2405463992216,3cyclictest0-21swapper/210:15:102
2405463992216,3cyclictest0-21swapper/209:40:152
2405463992216,3cyclictest0-21swapper/207:25:262
2405463992212,7cyclictest0-21swapper/207:40:252
2405463992212,6cyclictest2465252-21cut10:00:182
2405453992216,4cyclictest2405447-21cyclictest10:35:200
2405453992216,3cyclictest0-21swapper/011:20:190
2405453992216,3cyclictest0-21swapper/008:07:390
240545399220,18cyclictest0-21swapper/010:16:000
2405466992113,5cyclictest391ktimers/312:23:003
2405463992115,3cyclictest0-21swapper/211:10:152
240546399211,17cyclictest2440149-21tail08:45:262
2405463992015,3cyclictest2461951-21kernelversion09:50:212
2405463992014,3cyclictest0-21swapper/211:35:262
2405463992013,5cyclictest311ktimers/209:00:122
2405463992013,3cyclictest0-21swapper/209:40:012
2405463991913,3cyclictest2513142-21/usr/sbin/munin12:20:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional