You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 16:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Aug 22, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15235995041,6cyclictest108921-21ls11:40:002
15235994737,7cyclictest31310-21cron07:55:012
15235994638,4cyclictest57126-21munin-plugin-st09:10:012
15230994638,5cyclictest33023-21munin-plugin-st08:00:011
15230994632,10cyclictest231ktimers/108:50:131
15226994633,10cyclictest67343-21cron09:40:000
15239994436,5cyclictest36442-21idleruntime-cro08:10:013
15235994437,4cyclictest125776-21grep12:25:262
15235994231,7cyclictest79297-21grep10:10:252
15239994130,8cyclictest391ktimers/311:45:133
15239994130,8cyclictest106742-21unixbench_multi11:30:263
15235994134,5cyclictest53557-21kworker/u8:2+events_unbound09:00:162
15230994128,10cyclictest231ktimers/107:10:121
15239994023,14cyclictest391ktimers/308:22:103
15230994031,6cyclictest204-21dbus-daemon09:15:181
15230994025,11cyclictest231ktimers/108:40:121
15239993932,4cyclictest29625-21cut07:50:013
15239993931,6cyclictest89575-21kworker/u8:1+events_unbound10:45:313
15239993929,8cyclictest391ktimers/309:45:133
15239993927,6cyclictest131rcu_preempt11:38:553
15235993932,5cyclictest82748-21kworker/u8:0+events_unbound10:20:272
15235993928,8cyclictest106740-21grep11:30:262
15235993921,5cyclictest15218-21cyclictest10:00:242
15235993919,5cyclictest131rcu_preempt08:40:262
15226993925,11cyclictest121ktimers/008:30:130
15226993925,11cyclictest121ktimers/008:30:130
15239993832,4cyclictest72330-21kworker/u8:0+events_unbound10:00:233
15235993827,5cyclictest131rcu_preempt10:30:192
15235993827,5cyclictest131rcu_preempt10:30:192
1523599381,4cyclictest0-21swapper/207:10:112
15230993831,4cyclictest46868-21cron08:40:001
15226993830,4cyclictest0-21swapper/011:40:360
15239993731,4cyclictest83078-21kworker/u8:3+events_unbound10:35:303
15239993731,4cyclictest22573-21kworker/u8:3+events_unbound07:40:043
15239993728,6cyclictest118904-21grep12:05:253
15239993724,8cyclictest0-21swapper/310:25:273
15239993716,12cyclictest131rcu_preempt08:30:273
15239993716,12cyclictest131rcu_preempt08:30:263
15235993729,6cyclictest18816-21kworker/u8:1+events_unbound07:34:592
15235993727,6cyclictest0-21swapper/208:20:002
15235993716,5cyclictest15030-21kworker/u8:3-events_freezable_power_07:15:392
15230993728,5cyclictest126191-21ls12:30:001
15235993628,4cyclictest0-21swapper/211:10:142
15235993627,6cyclictest53305-21unixbench_singl08:55:262
15226993628,4cyclictest0-21swapper/012:35:000
15226993628,4cyclictest0-21swapper/012:35:000
15226993628,3cyclictest0-21swapper/010:25:000
15239993524,7cyclictest0-21swapper/311:40:243
15239993522,9cyclictest391ktimers/307:35:013
15239993516,3cyclictest131rcu_preempt09:05:193
1523599359,13cyclictest32-21ksoftirqd/207:25:242
15235993527,4cyclictest0-21swapper/210:40:252
15235993520,6cyclictest131rcu_preempt12:00:122
15235993516,5cyclictest131rcu_preempt08:20:132
15235993514,5cyclictest131rcu_preempt09:10:252
15230993528,4cyclictest0-21swapper/110:00:011
15230993525,6cyclictest0-21swapper/112:20:261
15230993524,7cyclictest231ktimers/111:35:131
15239993420,5cyclictest22573-21kworker/u8:3+events_unbound08:04:493
15239993420,3cyclictest131rcu_preempt11:00:253
15239993416,5cyclictest131rcu_preempt08:55:273
15239993413,9cyclictest131rcu_preempt08:35:243
15239993413,11cyclictest131rcu_preempt11:15:133
15239993412,5cyclictest131rcu_preempt08:27:403
15239993412,5cyclictest131rcu_preempt08:27:403
15239993410,15cyclictest40-21ksoftirqd/309:20:013
1523599347,14cyclictest32-21ksoftirqd/209:35:222
15235993426,4cyclictest0-21swapper/209:50:152
15235993426,3cyclictest0-21swapper/212:20:002
15235993425,6cyclictest0-21swapper/209:45:002
15235993424,6cyclictest0-21swapper/211:40:252
15235993419,5cyclictest131rcu_preempt07:20:152
15235993417,5cyclictest131rcu_preempt11:55:012
15235993416,5cyclictest131rcu_preempt07:45:122
15235993415,5cyclictest131rcu_preempt08:00:222
15235993414,5cyclictest131rcu_preempt11:45:242
15235993413,12cyclictest131rcu_preempt11:15:282
1523099345,4cyclictest131rcu_preempt10:40:131
15230993427,4cyclictest63956-21munin-plugin-st09:30:001
15230993426,4cyclictest0-21swapper/108:20:251
15226993426,4cyclictest0-21swapper/009:45:000
15226993425,5cyclictest0-21swapper/011:30:260
15226993424,6cyclictest0-21swapper/012:35:260
15226993424,6cyclictest0-21swapper/012:35:260
1523999337,22cyclictest391ktimers/311:25:003
15239993323,6cyclictest0-21swapper/307:50:253
15239993322,5cyclictest112066-21kworker/u8:0+events_unbound12:00:413
15239993321,9cyclictest391ktimers/309:55:023
15239993319,5cyclictest44993-21kworker/u8:0+events_unbound08:52:213
15239993319,4cyclictest131rcu_preempt09:40:243
15239993317,7cyclictest75916-21kworker/u8:1+events_unbound10:08:003
15239993317,3cyclictest131rcu_preempt08:45:173
15239993317,10cyclictest131rcu_preempt10:14:503
15239993315,4cyclictest131rcu_preempt08:17:103
15239993314,10cyclictest131rcu_preempt10:20:143
15239993313,11cyclictest131rcu_preempt09:35:013
15239993313,10cyclictest131rcu_preempt12:14:143
15235993326,5cyclictest50273-21kworker/u8:1+events_unbound09:20:202
15235993326,3cyclictest0-21swapper/209:45:162
15235993323,4cyclictest0-21swapper/210:10:012
15235993318,5cyclictest50273-21kworker/u8:1+events_unbound08:52:582
15235993318,4cyclictest131rcu_preempt10:35:252
15235993318,3cyclictest131rcu_preempt12:20:262
15235993317,5cyclictest131rcu_preempt09:25:252
15235993316,5cyclictest131rcu_preempt08:06:192
15235993316,3cyclictest131rcu_preempt10:47:532
15230993325,4cyclictest0-21swapper/111:55:001
15226993325,5cyclictest0-21swapper/007:25:240
15226993323,6cyclictest0-21swapper/008:05:290
15239993221,8cyclictest391ktimers/307:10:213
15239993219,4cyclictest131rcu_preempt12:35:133
15239993219,4cyclictest131rcu_preempt12:35:133
15239993218,4cyclictest131rcu_preempt09:20:383
15239993217,4cyclictest131rcu_preempt12:15:243
15239993216,7cyclictest50273-21kworker/u8:1+events_unbound09:11:293
15239993216,3cyclictest131rcu_preempt08:10:173
15239993214,9cyclictest131rcu_preempt12:20:143
15239993214,9cyclictest131rcu_preempt10:18:473
15239993213,4cyclictest131rcu_preempt10:35:003
15239993213,4cyclictest131rcu_preempt10:35:003
15239993213,16cyclictest391ktimers/310:57:303
15239993213,10cyclictest131rcu_preempt08:40:223
15239993210,6cyclictest40-21ksoftirqd/307:15:033
15235993225,4cyclictest0-21swapper/212:10:262
15235993219,5cyclictest129206-21kworker/u8:2+events_unbound12:35:432
15235993219,5cyclictest129206-21kworker/u8:2+events_unbound12:35:422
15235993217,4cyclictest131rcu_preempt08:10:122
15235993215,5cyclictest131rcu_preempt10:50:172
15235993215,3cyclictest131rcu_preempt10:15:142
15235993215,11cyclictest131rcu_preempt10:55:212
15235993214,4cyclictest0-21swapper/208:29:252
15235993214,4cyclictest0-21swapper/208:29:252
1523099323,4cyclictest131rcu_preempt12:35:121
1523099323,4cyclictest131rcu_preempt12:35:121
15230993226,4cyclictest98311-21kworker/u8:0+events_unbound11:20:351
15230993226,3cyclictest0-21swapper/108:15:161
15230993224,4cyclictest0-21swapper/110:15:261
15230993220,8cyclictest0-21swapper/109:10:011
15226993221,6cyclictest0-21swapper/009:00:250
1523999315,6cyclictest40-21ksoftirqd/307:25:013
15239993125,3cyclictest391ktimers/309:33:103
15239993123,4cyclictest33028-21grep08:00:013
15239993121,7cyclictest391ktimers/311:55:253
15239993121,7cyclictest391ktimers/311:25:263
15239993121,7cyclictest391ktimers/311:25:263
15239993121,6cyclictest0-21swapper/309:30:003
15239993113,4cyclictest131rcu_preempt11:10:113
15239993110,5cyclictest0-21swapper/311:50:233
1523599318,13cyclictest32-21ksoftirqd/212:05:162
15235993124,5cyclictest89575-21kworker/u8:1+events_unbound11:06:402
15235993124,5cyclictest110328-21kworker/u8:1+events_unbound11:55:402
15235993118,5cyclictest131rcu_preempt12:30:122
15235993118,5cyclictest131rcu_preempt12:30:122
15235993118,4cyclictest131rcu_preempt11:26:022
15235993118,4cyclictest131rcu_preempt11:26:022
15235993113,9cyclictest131rcu_preempt07:40:192
15235993110,5cyclictest131rcu_preempt08:50:012
15230993121,5cyclictest0-21swapper/111:45:161
1522699313,5cyclictest131rcu_preempt11:20:130
15239993020,7cyclictest391ktimers/307:40:013
15239993013,9cyclictest91800-21kworker/u8:2-events_freezable_power_11:05:123
15239993012,4cyclictest131rcu_preempt10:50:203
15239993010,12cyclictest40-21ksoftirqd/309:55:233
1523599309,11cyclictest131rcu_preempt09:15:202
1523599306,6cyclictest32-21ksoftirqd/209:30:182
15235993015,3cyclictest131rcu_preempt11:00:172
15235993011,9cyclictest131rcu_preempt09:59:442
1523099309,5cyclictest131rcu_preempt11:40:151
15230993023,4cyclictest0-21swapper/109:00:011
15230993022,4cyclictest0-21swapper/111:30:171
15230993022,4cyclictest0-21swapper/110:00:161
15226993024,3cyclictest105512-21kthreadd11:30:000
15226993024,3cyclictest105512-21kthreadd11:30:000
1522699301,26cyclictest0-21swapper/012:05:130
15239992919,7cyclictest391ktimers/310:40:263
15239992919,7cyclictest391ktimers/309:00:243
15239992915,4cyclictest131rcu_preempt12:30:173
15239992915,4cyclictest131rcu_preempt12:30:163
1523599297,12cyclictest32-21ksoftirqd/208:35:182
15235992922,4cyclictest0-21swapper/210:25:172
15235992921,6cyclictest44993-21kworker/u8:0+events_unbound08:33:412
15235992921,6cyclictest44993-21kworker/u8:0+events_unbound08:33:412
15235992917,4cyclictest131rcu_preempt07:35:022
15235992915,8cyclictest98672-21kworker/u8:3+events_unbound11:20:112
15230992920,4cyclictest0-21swapper/109:35:221
15230992918,7cyclictest86972-21grep10:35:171
15226992922,5cyclictest74059-21kworker/u8:2+events_unbound10:30:280
15226992922,5cyclictest74059-21kworker/u8:2+events_unbound10:30:280
15226992922,4cyclictest0-21swapper/007:25:010
15226992922,3cyclictest0-21swapper/012:20:000
15226992922,3cyclictest0-21swapper/009:50:240
15226992922,3cyclictest0-21swapper/008:45:130
15226992919,7cyclictest0-21swapper/012:25:000
1522699290,27cyclictest0-21swapper/010:45:130
1523999284,7cyclictest40-21ksoftirqd/312:25:223
15235992815,6cyclictest31014-21kworker/u8:1+events_unbound07:56:012
15230992820,4cyclictest0-21swapper/108:10:251
15230992820,4cyclictest0-21swapper/107:15:161
15230992819,5cyclictest0-21swapper/108:00:261
15226992820,5cyclictest0-21swapper/007:15:030
15226992819,6cyclictest0-21swapper/009:55:260
15226992819,6cyclictest0-21swapper/008:40:250
15226992816,9cyclictest13550irq/42-30be0000.ethernet09:10:010
1522699281,10cyclictest95269-21munin-plugin-st11:00:000
1523099272,4cyclictest131rcu_preempt11:00:121
15230992721,3cyclictest0-21swapper/110:25:241
15230992720,4cyclictest83078-21kworker/u8:3-ext4-rsv-conversion10:35:011
15230992720,4cyclictest83078-21kworker/u8:3-ext4-rsv-conversion10:35:001
15230992720,4cyclictest65180-21grep09:30:261
15230992720,4cyclictest0-21swapper/108:30:011
15230992720,4cyclictest0-21swapper/108:30:001
15230992720,3cyclictest0-21swapper/109:20:241
15230992718,5cyclictest79719-21idleruntime-cro10:15:001
15230992718,5cyclictest0-21swapper/110:50:261
15230992717,6cyclictest0-21swapper/111:15:001
15230992716,7cyclictest204-21dbus-daemon08:05:081
1522699275,12cyclictest131rcu_preempt11:15:240
15226992722,3cyclictest13550irq/42-30be0000.ethernet10:35:180
15226992720,4cyclictest0-21swapper/010:20:000
15226992719,5cyclictest0-21swapper/011:10:230
15226992719,4cyclictest0-21swapper/009:50:010
15230992618,5cyclictest0-21swapper/112:10:161
15230992618,5cyclictest0-21swapper/109:50:241
15230992618,4cyclictest0-21swapper/109:50:011
15230992618,4cyclictest0-21swapper/107:40:011
15230992618,4cyclictest0-21swapper/107:25:231
1522699269,10cyclictest131rcu_preempt12:02:090
1522699262,21cyclictest60563-21basename09:20:000
15226992620,3cyclictest0-21swapper/008:00:010
15226992619,4cyclictest0-21swapper/011:05:000
15226992618,5cyclictest0-21swapper/008:15:250
15226992616,6cyclictest0-21swapper/007:50:250
15226992610,13cyclictest0-21swapper/011:50:250
15230992519,4cyclictest117516-21kworker/u8:1+events_unbound12:15:411
15230992519,3cyclictest0-21swapper/112:30:231
15230992519,3cyclictest0-21swapper/112:30:231
15230992517,5cyclictest0-21swapper/107:20:261
15230992514,8cyclictest44071-21sed08:30:191
15230992514,8cyclictest44071-21sed08:30:191
1522699259,13cyclictest645-21runrttasks08:57:230
15226992518,4cyclictest0-21swapper/008:00:260
15226992517,5cyclictest0-21swapper/008:15:010
15226992517,4cyclictest0-21swapper/012:10:240
15230992418,4cyclictest75916-21kworker/u8:1+events_unbound10:06:411
15230992418,3cyclictest0-21swapper/107:45:171
15230992417,4cyclictest0-21swapper/107:50:251
15230992417,3cyclictest0-21swapper/110:45:191
15230992416,5cyclictest22817-21/usr/sbin/munin07:30:161
15230992416,4cyclictest0-21swapper/111:05:271
15230992414,6cyclictest53-21kcompactd012:05:261
1522699247,5cyclictest89101-21proc_pri10:40:220
1522699242,20cyclictest0-21swapper/009:20:160
15226992418,3cyclictest0-21swapper/008:50:250
15226992417,3cyclictest0-21swapper/011:57:520
15226992416,5cyclictest0-21swapper/012:25:220
15226992415,4cyclictest0-21swapper/007:40:270
15226992413,8cyclictest24458-21cut07:35:010
1522699241,19cyclictest0-21swapper/009:10:500
1522699240,22cyclictest121ktimers/011:05:210
15230992317,3cyclictest0-21swapper/107:40:201
15230992315,6cyclictest104514-21sed11:25:221
15230992315,6cyclictest104514-21sed11:25:211
15230992314,7cyclictest24-21ksoftirqd/111:55:201
1522699232,19cyclictest0-21swapper/007:17:070
15226992317,3cyclictest0-21swapper/011:45:230
15226992316,5cyclictest0-21swapper/008:26:360
15226992316,5cyclictest0-21swapper/008:26:360
15226992316,3cyclictest0-21swapper/010:03:480
15226992316,3cyclictest0-21swapper/009:29:510
1522699231,5cyclictest0-21swapper/008:23:260
15226992315,5cyclictest121ktimers/007:38:360
1522699231,19cyclictest0-21swapper/010:52:250
1522699231,10cyclictest78250-21grep10:10:130
15230992216,4cyclictest82748-21kworker/u8:0+events_unbound10:23:141
15230992216,3cyclictest0-21swapper/110:55:221
15230992216,3cyclictest0-21swapper/109:05:011
15226992216,3cyclictest0-21swapper/011:35:150
15226992216,2cyclictest0-21swapper/009:30:220
15226992215,5cyclictest0-21swapper/008:37:200
15226992215,3cyclictest0-21swapper/007:47:030
15230992115,4cyclictest145-21jbd2/mmcblk1p2-809:42:051
15230992115,3cyclictest0-21swapper/109:10:201
15230992115,3cyclictest0-21swapper/108:45:141
15230992110,8cyclictest116191-21apt12:00:121
15226992115,3cyclictest0-21swapper/010:25:270
1523099190,12cyclictest0-21swapper/111:18:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional