You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 20:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Jun 16, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3225463995337,11cyclictest121ktimers/007:20:140
3225466995142,6cyclictest215-21dbus-daemon07:25:173
3225465995141,7cyclictest3287657-21grep10:05:282
3225465995043,5cyclictest3234427-21kworker/u8:2+events_unbound07:40:262
3225466994842,4cyclictest3234427-21kworker/u8:2+events_unbound07:55:393
3225465994842,4cyclictest3331185-21kworker/u8:2+events_unbound12:36:282
3225464994740,4cyclictest3308757-21munin-plugin-st11:10:001
3225464994740,4cyclictest3308757-21munin-plugin-st11:09:591
3225465994640,4cyclictest3281066-21kworker/u8:2+events_unbound09:51:062
3225463994633,10cyclictest121ktimers/011:20:170
3225465994534,5cyclictest3260342-21kworker/u8:0+events_unbound09:05:562
3225464994539,4cyclictest3334924-21kworker/u8:1+events_unbound12:31:261
3225464994539,4cyclictest3315584-21munin-plugin-st11:30:011
3225465994438,4cyclictest3234427-21kworker/u8:2+events_unbound08:05:472
3225465994434,7cyclictest3273761-21grep09:25:282
3225465994433,8cyclictest3241965-21sshd07:55:372
3225465994332,7cyclictest1-21systemd07:25:182
3225465994327,5cyclictest131rcu_preempt08:45:292
3225466994231,7cyclictest0-21swapper/312:05:013
3225466994231,7cyclictest0-21swapper/312:05:013
3225465994235,5cyclictest3326151-21kworker/u8:3+events_unbound12:11:242
3225465994235,5cyclictest3326151-21kworker/u8:3+events_unbound12:11:242
3225465994235,5cyclictest3236176-21kworker/u8:0+events_unbound07:50:342
3225465994227,11cyclictest311ktimers/212:20:132
3225465994227,11cyclictest311ktimers/212:20:132
3225464994237,2cyclictest0-21swapper/109:45:121
3225464994237,2cyclictest0-21swapper/109:45:121
3225464994131,7cyclictest3265687-21sh09:05:001
3225464994129,9cyclictest231ktimers/112:20:141
3225464994129,9cyclictest231ktimers/112:20:131
3225463994135,4cyclictest0-21swapper/011:55:160
3225463994129,8cyclictest3282624-21sshd09:51:050
3225466994028,8cyclictest0-21swapper/311:05:013
3225465994034,4cyclictest3282774-21kworker/u8:0+events_unbound10:01:092
3225465994033,4cyclictest3294904-21kthreadd10:30:012
3225465994029,7cyclictest0-21swapper/210:20:012
3225465994021,10cyclictest131rcu_preempt11:00:162
3225464994032,4cyclictest0-21swapper/111:25:011
3225464994030,7cyclictest3298317-21sendmail10:40:011
3225464994026,8cyclictest131rcu_preempt10:15:261
3225464994016,15cyclictest131rcu_preempt07:45:261
3225463994030,7cyclictest3284676-21sendmail09:59:590
3225464993929,6cyclictest3232444-21head07:25:261
3225464993925,11cyclictest231ktimers/109:50:151
3225464993917,10cyclictest131rcu_preempt10:14:401
3225463993929,7cyclictest3273808-21grep09:25:280
3225466993829,6cyclictest0-21swapper/307:45:013
3225466993828,6cyclictest0-21swapper/310:45:003
3225466993828,6cyclictest0-21swapper/307:20:013
3225466993827,7cyclictest0-21swapper/311:40:013
3225465993819,4cyclictest131rcu_preempt10:40:112
3225464993825,5cyclictest131rcu_preempt10:45:011
3225464993821,4cyclictest131rcu_preempt11:45:201
3225464993819,11cyclictest131rcu_preempt08:20:211
3225463993831,4cyclictest3340303-21munin-run12:40:000
3225463993830,4cyclictest0-21swapper/012:30:010
3225463993826,8cyclictest215-21dbus-daemon10:06:080
322546699378,15cyclictest40-21ksoftirqd/310:50:003
3225466993728,6cyclictest0-21swapper/308:25:003
3225466993722,6cyclictest3275643-21kworker/u8:1+events_unbound09:35:033
3225465993727,6cyclictest0-21swapper/208:45:012
3225465993721,4cyclictest131rcu_preempt12:33:442
3225465993720,3cyclictest131rcu_preempt12:17:542
3225465993720,3cyclictest131rcu_preempt12:17:532
3225465993719,10cyclictest131rcu_preempt11:55:012
3225464993731,4cyclictest3296517-21kworker/u8:2+events_unbound10:56:171
3225464993729,6cyclictest3249882-21kworker/u8:1+events_unbound08:25:421
3225464993729,6cyclictest3249882-21kworker/u8:1+events_unbound08:25:421
3225464993729,5cyclictest3324735-21cron11:55:001
3225464993722,4cyclictest131rcu_preempt08:30:271
3225464993721,5cyclictest131rcu_preempt11:40:031
3225464993720,11cyclictest131rcu_preempt08:50:481
322546399379,3cyclictest33091282uniq11:10:210
3225463993730,4cyclictest0-21swapper/007:40:000
3225466993626,6cyclictest0-21swapper/307:30:273
3225466993618,9cyclictest131rcu_preempt12:10:193
3225466993618,9cyclictest131rcu_preempt12:10:193
3225466993616,7cyclictest131rcu_preempt09:50:163
3225465993628,6cyclictest3291260-21kworker/u8:1+events_unbound10:21:112
3225465993628,6cyclictest3249882-21kworker/u8:1+events_unbound08:27:442
3225465993628,6cyclictest3249882-21kworker/u8:1+events_unbound08:27:432
3225465993628,4cyclictest0-21swapper/211:10:002
3225465993628,4cyclictest0-21swapper/211:09:592
3225465993620,5cyclictest3223597-21kworker/u8:1-events_freezable_power_07:22:052
3225465993620,10cyclictest131rcu_preempt11:00:002
3225465993619,5cyclictest131rcu_preempt11:40:332
3225465993617,8cyclictest131rcu_preempt09:55:152
3225465993616,9cyclictest131rcu_preempt08:20:402
3225465993616,5cyclictest131rcu_preempt12:25:202
3225465993616,12cyclictest131rcu_preempt11:35:012
3225464993627,5cyclictest3245003-21debian-sa108:05:011
3225464993617,10cyclictest131rcu_preempt07:20:141
3225466993526,6cyclictest0-21swapper/312:40:003
3225466993525,6cyclictest0-21swapper/311:50:313
3225466993524,7cyclictest0-21swapper/310:05:003
3225466993523,4cyclictest131rcu_preempt08:45:193
3225466993519,7cyclictest131rcu_preempt12:35:003
3225466993518,5cyclictest131rcu_preempt08:45:013
3225466993516,9cyclictest131rcu_preempt09:40:193
3225466993510,17cyclictest131rcu_preempt12:20:253
3225466993510,17cyclictest131rcu_preempt12:20:243
3225465993526,4cyclictest0-21swapper/208:40:002
3225465993524,7cyclictest0-21swapper/211:25:282
3225465993524,7cyclictest0-21swapper/208:55:002
3225465993520,4cyclictest131rcu_preempt09:22:582
3225465993520,4cyclictest131rcu_preempt08:00:132
3225465993516,5cyclictest131rcu_preempt10:45:272
3225465993513,5cyclictest131rcu_preempt09:00:212
3225464993528,4cyclictest0-21swapper/109:35:001
3225464993520,4cyclictest131rcu_preempt12:15:261
3225464993520,4cyclictest131rcu_preempt12:15:261
3225464993519,5cyclictest131rcu_preempt10:05:201
3225464993517,9cyclictest131rcu_preempt07:15:161
3225464993517,11cyclictest3296517-21kworker/u8:2+events_unbound10:34:261
3225464993515,11cyclictest3255094-21kworker/u8:1+events_unbound08:38:091
3225464993513,11cyclictest131rcu_preempt08:55:271
3225464993512,13cyclictest131rcu_preempt07:55:111
3225464993511,12cyclictest131rcu_preempt07:50:211
3225466993426,6cyclictest3234427-21kworker/u8:2+events_unbound07:37:433
3225466993426,4cyclictest0-21swapper/308:20:013
3225466993423,5cyclictest3322546-21kworker/u8:2+events_unbound11:56:233
3225466993422,5cyclictest131rcu_preempt08:50:303
3225466993419,9cyclictest131rcu_preempt07:20:263
3225466993418,10cyclictest131rcu_preempt12:15:213
3225466993418,10cyclictest131rcu_preempt12:15:213
3225466993416,5cyclictest131rcu_preempt10:20:013
3225465993428,4cyclictest3279317-21kworker/u8:1+events_unbound09:46:062
3225465993428,4cyclictest3279317-21kworker/u8:1+events_unbound09:46:062
3225465993426,4cyclictest0-21swapper/212:00:002
3225465993424,7cyclictest3227124-21awk07:15:002
3225465993420,5cyclictest131rcu_preempt09:40:242
3225465993420,4cyclictest131rcu_preempt11:10:272
3225465993419,9cyclictest131rcu_preempt09:30:292
3225465993419,9cyclictest131rcu_preempt07:45:202
3225465993419,5cyclictest131rcu_preempt08:30:152
3225465993419,3cyclictest131rcu_preempt08:16:462
3225465993418,5cyclictest3281066-21kworker/u8:2+events_unbound10:14:142
3225465993418,5cyclictest131rcu_preempt09:10:232
3225465993418,10cyclictest131rcu_preempt09:15:262
3225465993418,10cyclictest131rcu_preempt07:35:212
3225465993417,5cyclictest3275643-21kworker/u8:1+events_unbound09:36:492
3225465993417,4cyclictest131rcu_preempt11:20:292
3225465993414,10cyclictest131rcu_preempt08:58:202
3225465993412,9cyclictest0-21swapper/212:05:192
3225465993411,15cyclictest0-21swapper/211:15:242
3225465993411,11cyclictest131rcu_preempt11:39:312
3225464993426,4cyclictest0-21swapper/107:30:171
3225464993425,6cyclictest3272071-21grep09:20:291
3225464993425,6cyclictest0-21swapper/112:05:281
3225464993416,4cyclictest131rcu_preempt12:25:211
3225464993415,5cyclictest131rcu_preempt11:15:241
3225464993415,10cyclictest131rcu_preempt08:40:171
3225464993412,7cyclictest24-21ksoftirqd/111:40:001
3225464993412,13cyclictest131rcu_preempt12:00:221
3225464993412,13cyclictest131rcu_preempt12:00:221
3225463993427,4cyclictest3289778-21cron10:15:010
322546699337,14cyclictest40-21ksoftirqd/311:25:293
3225466993323,6cyclictest0-21swapper/311:45:303
3225466993323,6cyclictest0-21swapper/308:35:303
3225466993318,9cyclictest131rcu_preempt11:40:303
3225466993318,4cyclictest131rcu_preempt11:30:283
3225466993317,5cyclictest131rcu_preempt07:10:183
322546699331,5cyclictest0-21swapper/310:20:163
3225465993316,4cyclictest131rcu_preempt07:33:282
3225465993316,11cyclictest131rcu_preempt10:53:172
3225465993316,11cyclictest131rcu_preempt07:16:192
3225465993313,13cyclictest131rcu_preempt11:45:272
3225465993313,10cyclictest131rcu_preempt08:10:252
322546499339,13cyclictest24-21ksoftirqd/109:40:181
3225464993325,5cyclictest221rcuc/110:00:161
3225464993324,6cyclictest3302990-21grep10:50:281
3225464993316,4cyclictest131rcu_preempt07:40:171
3225464993315,4cyclictest131rcu_preempt10:22:521
3225464993313,9cyclictest131rcu_preempt11:10:191
3225464993312,11cyclictest131rcu_preempt09:55:241
3225464993310,5cyclictest131rcu_preempt08:11:351
3225464993310,13cyclictest24-21ksoftirqd/109:05:251
3225463993326,5cyclictest121ktimers/012:00:150
3225463993326,5cyclictest121ktimers/012:00:150
3225463993322,8cyclictest3243287-21cron08:00:010
322546699327,7cyclictest40-21ksoftirqd/309:20:003
3225466993226,4cyclictest3260342-21kworker/u8:0+events_unbound08:55:543
3225466993219,7cyclictest131rcu_preempt09:10:233
3225466993219,5cyclictest3260342-21kworker/u8:0+events_unbound09:01:503
3225466993219,10cyclictest391ktimers/311:15:153
3225466993218,8cyclictest131rcu_preempt11:20:243
3225466993218,8cyclictest131rcu_preempt10:25:263
3225466993218,8cyclictest131rcu_preempt09:45:193
3225466993218,8cyclictest131rcu_preempt09:45:193
3225466993217,9cyclictest131rcu_preempt10:30:233
3225466993217,5cyclictest131rcu_preempt12:25:273
3225466993217,4cyclictest131rcu_preempt07:45:273
3225466993215,6cyclictest131rcu_preempt08:10:163
3225466993213,8cyclictest131rcu_preempt09:55:173
3225466993213,4cyclictest0-21swapper/309:05:193
3225465993217,5cyclictest3296517-21kworker/u8:2+events_unbound10:34:432
3225465993213,10cyclictest131rcu_preempt12:00:262
3225465993213,10cyclictest131rcu_preempt12:00:262
322546499329,13cyclictest24-21ksoftirqd/107:15:011
322546499328,15cyclictest24-21ksoftirqd/108:50:021
322546499327,15cyclictest24-21ksoftirqd/111:30:301
3225464993218,4cyclictest131rcu_preempt09:15:211
3225464993218,3cyclictest131rcu_preempt07:35:241
3225464993214,5cyclictest131rcu_preempt11:00:181
3225464993212,11cyclictest131rcu_preempt09:10:321
3225464993211,11cyclictest131rcu_preempt10:48:141
3225464993210,6cyclictest131rcu_preempt10:25:281
3225466993123,5cyclictest0-21swapper/311:10:313
3225466993122,6cyclictest3288080-21idleruntime-cro10:10:003
3225466993122,6cyclictest0-21swapper/312:05:283
3225466993121,6cyclictest0-21swapper/310:55:273
3225466993118,5cyclictest131rcu_preempt09:25:013
3225466993116,4cyclictest3296517-21kworker/u8:2+events_unbound10:36:493
3225466993115,9cyclictest131rcu_preempt09:25:273
322546499319,13cyclictest131rcu_preempt08:05:181
322546499319,10cyclictest131rcu_preempt09:35:061
322546499318,5cyclictest0-21swapper/109:25:191
3225464993113,5cyclictest131rcu_preempt12:35:161
3225464993113,10cyclictest131rcu_preempt12:13:231
3225464993113,10cyclictest131rcu_preempt12:13:231
3225463993122,6cyclictest0-21swapper/007:40:170
322546699308,9cyclictest40-21ksoftirqd/308:00:173
3225466993022,4cyclictest0-21swapper/310:10:293
3225466993016,4cyclictest131rcu_preempt08:07:413
3225466993014,4cyclictest131rcu_preempt09:30:183
3225466993013,3cyclictest131rcu_preempt07:50:173
3225466993012,4cyclictest131rcu_preempt08:25:243
3225466993012,4cyclictest131rcu_preempt08:25:233
322546499308,5cyclictest131rcu_preempt08:15:161
322546499304,7cyclictest24-21ksoftirqd/111:55:291
3225463993018,8cyclictest215-21dbus-daemon10:31:100
322546699297,18cyclictest391ktimers/310:55:003
3225466992918,4cyclictest131rcu_preempt08:30:243
3225466992910,12cyclictest131rcu_preempt11:05:283
3225466992910,12cyclictest131rcu_preempt11:05:283
3225463992922,5cyclictest3268881-21kworker/u8:2+events_unbound09:16:000
3225463992921,4cyclictest0-21swapper/010:40:260
3225463992916,10cyclictest3225461-21cyclictest07:25:130
3225463992822,4cyclictest3220088-21kworker/u8:0+events_unbound07:10:180
3225463992820,6cyclictest3319192-21sendmail11:40:010
3225463992820,5cyclictest0-21swapper/009:05:290
3225463992820,4cyclictest0-21swapper/009:20:290
3225463992818,4cyclictest3275643-21kworker/u8:1+events_unbound09:35:210
3225463992815,5cyclictest0-21swapper/008:10:010
3225463992719,4cyclictest0-21swapper/011:05:000
3225463992719,4cyclictest0-21swapper/009:00:010
3225463992719,4cyclictest0-21swapper/008:35:300
3225463992620,3cyclictest0-21swapper/009:35:010
3225463992618,5cyclictest0-21swapper/009:10:320
3225463992618,4cyclictest0-21swapper/010:35:330
3225463992613,9cyclictest215-21dbus-daemon07:15:170
3225463992613,4cyclictest0-21swapper/012:20:000
3225463992613,4cyclictest0-21swapper/012:20:000
322546399258,4cyclictest131rcu_preempt12:30:290
3225463992517,5cyclictest0-21swapper/011:25:290
322546399251,6cyclictest3302675-21/usr/sbin/munin10:50:270
3225463992516,6cyclictest3322817-21sh11:50:000
322546399251,21cyclictest121ktimers/007:50:240
322546399245,4cyclictest131rcu_preempt09:45:190
322546399245,4cyclictest131rcu_preempt09:45:190
322546399243,4cyclictest131rcu_preempt08:25:130
322546399243,4cyclictest131rcu_preempt08:25:130
3225463992420,2cyclictest13650irq/42-30be0000.ethernet11:05:140
3225463992420,2cyclictest13650irq/42-30be0000.ethernet11:05:140
3225463992418,4cyclictest3277568-21kworker/u8:0+events_unbound09:40:410
3225463992418,3cyclictest13950irq/36-mmc108:15:010
3225463992417,4cyclictest13950irq/36-mmc108:20:010
3225463992417,3cyclictest0-21swapper/011:15:160
3225463992417,3cyclictest0-21swapper/008:52:310
322546399241,19cyclictest0-21swapper/007:32:120
322546399231,7cyclictest3301317-21grep10:45:280
3225463992316,4cyclictest0-21swapper/008:45:300
3225463992314,5cyclictest0-21swapper/010:20:120
322546399231,3cyclictest3323379-21df11:50:210
322546399231,18cyclictest0-21swapper/010:01:300
322546399230,19cyclictest0-21swapper/011:31:580
322546399230,19cyclictest0-21swapper/010:16:190
3225463992216,4cyclictest3249882-21kworker/u8:1+events_unbound08:20:390
3225463992216,3cyclictest0-21swapper/012:05:260
3225463992216,3cyclictest0-21swapper/007:45:270
3225463992216,2cyclictest0-21swapper/012:10:220
3225463992216,2cyclictest0-21swapper/012:10:210
3225463992214,5cyclictest3320681-21unixbench_multi11:40:340
322546399221,3cyclictest3333516-21apt-get12:20:120
322546399221,3cyclictest3333516-21apt-get12:20:110
322546399221,19cyclictest0-21swapper/009:04:290
322546399221,17cyclictest0-21swapper/008:01:240
3225463992116,3cyclictest3304363-21mailstats10:55:250
322546399211,3cyclictest131rcu_preempt08:40:270
322546399211,18cyclictest0-21swapper/010:28:070
322546399211,16cyclictest0-21swapper/008:32:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional