You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 23:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Nov 20, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3421736995322,26cyclictest0-21swapper/209:50:422
3421736994819,8cyclictest3464038-21tune2fs09:10:162
3421736994514,5cyclictest0-21swapper/210:00:152
3421736994438,3cyclictest3530781-21debian-sa112:25:002
3421736994437,4cyclictest3439336-21sendmail08:00:012
3421731994437,4cyclictest3460617-21fschecks_count09:00:171
3421731994434,7cyclictest3463628-21sh09:10:001
3421736994337,4cyclictest146-21jbd2/mmcblk1p2-808:55:462
3421736994337,4cyclictest146-21jbd2/mmcblk1p2-808:55:452
3421736994330,8cyclictest3454475-21grep08:40:222
3421729994315,6cyclictest131rcu_preempt07:10:120
3421740994234,5cyclictest3439372-21latency_hist08:00:013
3421731994233,6cyclictest3428676-21unixbench_singl07:25:251
3421731994030,7cyclictest3535892-21munin-plugin-st12:40:001
3421731994030,7cyclictest3535892-21munin-plugin-st12:39:591
3421731994029,7cyclictest0-21swapper/109:55:001
3421729994033,4cyclictest3475582-21idleruntime-cro09:45:010
3421729994033,4cyclictest0-21swapper/011:50:130
3421729994032,4cyclictest0-21swapper/008:35:010
3421729994031,5cyclictest0-21swapper/011:40:000
3421729994029,7cyclictest121ktimers/007:30:120
3421740993932,5cyclictest3504424-21kworker/u8:1+events_unbound11:16:043
3421740993932,5cyclictest3504424-21kworker/u8:1+events_unbound11:16:043
3421736993928,7cyclictest3428641-21grep07:25:252
3421729993916,12cyclictest3487254-21runrttasks10:17:050
3421731993831,5cyclictest3511463-21kworker/u8:1+events_unbound11:31:071
342172999383,9cyclictest11-21ksoftirqd/010:30:120
3421729993830,4cyclictest0-21swapper/009:15:460
3421740993728,6cyclictest3504366-21grep11:05:243
3421740993725,6cyclictest3511463-21kworker/u8:1+events_unbound11:45:283
3421736993726,7cyclictest3440825-21grep08:00:252
3421736993725,9cyclictest3453165-21cron08:40:012
3421736993725,9cyclictest3453165-21cron08:40:002
3421731993728,5cyclictest0-21swapper/108:00:251
342172999371,10cyclictest11-21ksoftirqd/012:10:120
3421736993627,4cyclictest0-21swapper/210:40:172
3421736993625,7cyclictest3499434-21sh10:55:002
342173199364,4cyclictest131rcu_preempt08:50:141
3421731993629,5cyclictest3470137-21kworker/u8:1+events_unbound09:29:421
3421729993628,4cyclictest0-21swapper/010:20:540
3421729993623,9cyclictest121ktimers/008:45:120
3421729993620,3cyclictest131rcu_preempt07:55:010
342172999361,9cyclictest11-21ksoftirqd/007:55:110
3421740993527,5cyclictest3425679-21munin-plugin-st07:20:013
3421740993524,7cyclictest3440826-21grep08:00:253
3421736993527,5cyclictest3480258-21unixbench_singl09:55:252
3421736993526,5cyclictest0-21swapper/208:15:292
3421731993525,6cyclictest0-21swapper/109:35:221
3421731993525,6cyclictest0-21swapper/109:20:011
3421729993528,4cyclictest3460202-21auditctl09:00:000
3421729993528,4cyclictest3460202-21auditctl09:00:000
3421740993426,4cyclictest3449770-21sh08:30:003
3421740993417,4cyclictest131rcu_preempt07:20:133
3421736993426,4cyclictest0-21swapper/212:00:012
3421736993424,6cyclictest0-21swapper/211:20:002
3421736993424,6cyclictest0-21swapper/211:20:002
3421731993427,4cyclictest0-21swapper/111:15:261
3421731993427,4cyclictest0-21swapper/111:15:251
3421731993424,7cyclictest0-21swapper/108:50:011
3421731993424,7cyclictest0-21swapper/107:10:271
3421729993428,4cyclictest3530556-21kworker/u8:3+events_unbound12:26:180
3421729993427,3cyclictest0-21swapper/008:15:000
3421729993426,5cyclictest151rcuc/009:35:100
3421729993426,4cyclictest0-21swapper/011:40:160
3421729993426,4cyclictest0-21swapper/011:20:170
3421729993425,5cyclictest3476850-21head09:45:290
3421729993420,5cyclictest3478939-21kworker/u8:1+events_unbound10:07:440
3421740993325,4cyclictest0-21swapper/309:15:363
3421740993312,13cyclictest131rcu_preempt09:10:173
3421736993326,4cyclictest3492615-21sh10:35:002
3421736993325,5cyclictest3512013-21apt-key11:30:022
3421736993325,4cyclictest0-21swapper/208:20:272
3421736993324,4cyclictest0-21swapper/207:35:002
3421736993322,8cyclictest3490929-21munin-plugin-st10:30:012
3421731993325,4cyclictest0-21swapper/111:45:281
3421731993324,6cyclictest0-21swapper/110:45:251
3421731993323,6cyclictest0-21swapper/112:20:241
3421731993323,6cyclictest0-21swapper/112:10:261
3421731993322,7cyclictest0-21swapper/107:55:021
3421731993322,6cyclictest0-21swapper/110:40:251
342172999338,14cyclictest11-21ksoftirqd/007:45:240
3421729993326,4cyclictest0-21swapper/010:25:260
3421729993326,3cyclictest0-21swapper/011:30:000
3421729993324,7cyclictest3442581-21kworker/u8:2+events_unbound08:25:380
3421729993322,7cyclictest3453195-21sendmail08:40:000
3421729993322,7cyclictest3453195-21sendmail08:40:000
3421740993226,4cyclictest3484085-21kworker/u8:3+events_unbound10:15:543
3421740993224,4cyclictest0-21swapper/312:25:223
3421740993224,4cyclictest0-21swapper/310:40:003
3421740993222,7cyclictest3481973-21grep10:00:243
3421740993216,9cyclictest131rcu_preempt12:19:043
3421736993222,5cyclictest0-21swapper/207:15:182
342173199325,5cyclictest0-21swapper/110:30:121
3421731993223,6cyclictest0-21swapper/108:05:241
3421731993222,6cyclictest0-21swapper/112:00:251
3421731993222,6cyclictest0-21swapper/111:05:001
3421731993222,6cyclictest0-21swapper/110:10:271
3421731993222,6cyclictest0-21swapper/110:10:271
3421731993222,6cyclictest0-21swapper/108:20:281
3421731993222,6cyclictest0-21swapper/108:20:001
3421731993222,6cyclictest0-21swapper/107:30:261
3421731993221,7cyclictest0-21swapper/108:35:291
3421731993221,7cyclictest0-21swapper/108:35:291
3421731993221,7cyclictest0-21swapper/108:30:231
3421729993225,3cyclictest0-21swapper/012:40:000
3421729993225,3cyclictest0-21swapper/012:40:000
3421729993225,3cyclictest0-21swapper/007:20:150
3421729993222,6cyclictest3432033-21grep07:35:260
3421729993222,6cyclictest3432033-21grep07:35:250
342172999321,15cyclictest11-21ksoftirqd/011:50:010
3421740993123,4cyclictest0-21swapper/308:40:223
3421740993121,7cyclictest3452700-21grep08:35:303
3421740993121,7cyclictest3452700-21grep08:35:293
3421740993120,7cyclictest3432034-21grep07:35:253
3421740993120,7cyclictest3432034-21grep07:35:253
3421740993114,9cyclictest131rcu_preempt09:35:513
3421736993123,4cyclictest0-21swapper/209:20:012
3421736993120,7cyclictest3504332-21grep11:05:252
3421731993122,6cyclictest0-21swapper/110:05:241
3421731993122,6cyclictest0-21swapper/107:20:241
3421731993121,6cyclictest0-21swapper/109:45:291
3421731993121,6cyclictest0-21swapper/107:15:281
3421729993123,5cyclictest121ktimers/012:00:120
3421729993121,6cyclictest0-21swapper/012:15:260
3421729993116,3cyclictest131rcu_preempt10:58:180
3421740993023,5cyclictest3432468-21kworker/u8:1+events_unbound07:45:433
342174099301,14cyclictest0-21swapper/309:55:263
3421736993023,3cyclictest0-21swapper/211:40:152
3421736993022,4cyclictest0-21swapper/207:50:252
3421736993020,6cyclictest3518836-21sh11:50:002
3421736993020,6cyclictest0-21swapper/209:20:252
3421731993022,5cyclictest0-21swapper/107:55:241
3421731993021,5cyclictest0-21swapper/108:10:161
3421731993020,6cyclictest0-21swapper/107:45:261
342172999309,13cyclictest131rcu_preempt08:15:250
3421729993014,7cyclictest11-21ksoftirqd/011:20:010
3421729993014,7cyclictest11-21ksoftirqd/011:20:000
3421729993011,5cyclictest131rcu_preempt11:00:130
342174099298,13cyclictest0-21swapper/308:15:183
3421740992923,4cyclictest3518601-21kworker/u8:2+events_unbound11:56:043
3421740992922,5cyclictest3501280-21kworker/u8:2+events_unbound11:01:433
3421740992922,4cyclictest0-21swapper/311:40:243
3421740992922,4cyclictest0-21swapper/310:10:183
3421740992922,4cyclictest0-21swapper/310:10:183
3421740992920,5cyclictest0-21swapper/308:50:003
3421740992919,6cyclictest3422956-21grep07:10:263
3421740992918,5cyclictest3478939-21kworker/u8:1+events_unbound10:05:053
342174099291,16cyclictest0-21swapper/312:31:303
3421736992921,4cyclictest0-21swapper/208:10:252
3421731992921,5cyclictest221rcuc/109:45:001
3421731992921,4cyclictest0-21swapper/109:55:521
3421731992921,4cyclictest0-21swapper/108:40:131
3421731992920,5cyclictest0-21swapper/110:00:151
3421731992919,6cyclictest0-21swapper/111:50:261
3421731992919,6cyclictest0-21swapper/108:25:331
3421729992923,4cyclictest3459928-21kworker/u8:0+events_unbound09:21:420
342172999291,8cyclictest11-21ksoftirqd/009:50:130
3421729992915,5cyclictest3463563-21kworker/u8:2+events_unbound09:11:380
3421729992915,10cyclictest121ktimers/009:55:120
3421729992912,6cyclictest131rcu_preempt08:20:140
342172999291,14cyclictest3506229-21runrttasks11:12:070
342172999291,11cyclictest0-21swapper/012:06:520
342174099287,13cyclictest2277399-21kworker/3:2-mm_percpu_wq11:23:433
3421740992822,4cyclictest3499254-21kworker/u8:1+events_unbound10:56:033
3421740992821,4cyclictest0-21swapper/307:40:183
3421740992821,4cyclictest0-21swapper/307:30:163
3421740992821,3cyclictest381rcuc/311:30:003
3421740992819,6cyclictest3495614-21grep10:40:263
3421740992814,5cyclictest131rcu_preempt12:37:403
3421740992814,5cyclictest131rcu_preempt12:37:403
3421740992814,10cyclictest0-21swapper/311:36:063
3421740992813,3cyclictest131rcu_preempt12:00:113
3421736992819,6cyclictest3514632-21grep11:36:042
3421731992819,6cyclictest0-21swapper/107:40:261
3421731992818,6cyclictest0-21swapper/111:20:261
3421731992818,6cyclictest0-21swapper/107:40:011
3421731992818,6cyclictest0-21swapper/107:40:001
342173199281,5cyclictest131rcu_preempt12:25:091
3421729992817,6cyclictest13650irq/42-30be0000.ethernet12:20:120
3421729992815,4cyclictest131rcu_preempt10:11:000
3421729992815,4cyclictest131rcu_preempt10:11:000
3421729992815,3cyclictest0-21swapper/007:15:170
342174099276,13cyclictest40-21ksoftirqd/309:06:493
3421740992722,3cyclictest3484085-21kworker/u8:3-events_freezable_power_10:25:193
3421740992721,4cyclictest53-21kcompactd010:20:153
3421740992721,4cyclictest3468387-21kworker/u8:2+events_unbound09:31:413
3421740992721,3cyclictest0-21swapper/311:50:183
3421740992720,5cyclictest3473598-21kworker/u8:2+events_unbound09:53:573
3421740992720,4cyclictest0-21swapper/308:30:243
3421740992714,3cyclictest131rcu_preempt07:25:133
3421736992720,4cyclictest3421720-21cyclictest09:45:282
3421736992720,3cyclictest0-21swapper/210:05:532
3421736992718,5cyclictest0-21swapper/211:30:292
3421736992717,7cyclictest3520535-21sh11:55:002
3421736992717,6cyclictest0-21swapper/211:15:002
3421736992715,9cyclictest1-21systemd12:01:142
3421736992715,7cyclictest3423371-21basename07:15:012
3421731992720,5cyclictest3487125-21kworker/u8:0+events_unbound10:29:411
3421731992718,6cyclictest3511813-21ls11:30:001
3421731992718,6cyclictest0-21swapper/111:55:231
3421731992718,6cyclictest0-21swapper/110:20:251
3421731992718,5cyclictest0-21swapper/110:55:161
3421731992713,11cyclictest24-21ksoftirqd/110:35:231
342172999279,11cyclictest0-21swapper/009:25:060
342172999277,9cyclictest11-21ksoftirqd/010:35:160
342172999277,3cyclictest131rcu_preempt10:00:150
342172999276,10cyclictest11-21ksoftirqd/008:40:110
342172999275,11cyclictest11-21ksoftirqd/011:55:210
342172999274,4cyclictest131rcu_preempt10:50:250
342172999273,4cyclictest3462153-21apt-get09:05:090
342172999271,8cyclictest11-21ksoftirqd/007:40:130
3421729992716,7cyclictest3513318-21grep11:30:280
3421729992710,6cyclictest11-21ksoftirqd/010:40:260
342174099267,10cyclictest40-21ksoftirqd/311:30:013
342174099267,10cyclictest40-21ksoftirqd/308:20:183
342174099264,13cyclictest3497545-21kworker/u8:0+events_power_efficient10:48:483
342174099262,3cyclictest131rcu_preempt09:25:003
3421740992620,4cyclictest3523924-21kworker/u8:1+events_unbound12:13:013
3421740992618,4cyclictest0-21swapper/310:30:263
3421740992617,6cyclictest53-21kcompactd010:50:173
3421740992611,9cyclictest0-21swapper/309:25:133
342173699267,3cyclictest3448371-21cat08:25:112
3421736992618,4cyclictest3432497-21sh07:40:002
3421736992618,4cyclictest3432497-21sh07:40:002
3421736992618,4cyclictest0-21swapper/209:30:202
3421736992615,7cyclictest3458079-21grep08:50:262
3421736992614,8cyclictest1-21systemd07:40:202
3421731992618,5cyclictest0-21swapper/109:30:261
342173199260,5cyclictest131rcu_preempt11:35:121
342172999265,10cyclictest11-21ksoftirqd/008:50:020
3421729992619,5cyclictest3470137-21kworker/u8:1+events_unbound09:30:500
3421729992613,9cyclictest215-21dbus-daemon07:25:170
342172999261,12cyclictest0-21swapper/008:01:330
342174099258,11cyclictest0-21swapper/308:10:253
342174099257,6cyclictest131rcu_preempt08:50:253
3421740992518,5cyclictest3442581-21kworker/u8:2+events_unbound08:09:043
3421740992518,4cyclictest0-21swapper/312:05:243
3421740992514,3cyclictest131rcu_preempt09:45:293
3421740992512,9cyclictest391ktimers/309:40:163
342174099250,7cyclictest3436657-21ls07:50:193
3421736992518,4cyclictest0-21swapper/208:50:002
3421736992517,4cyclictest0-21swapper/210:35:262
3421736992517,4cyclictest0-21swapper/208:05:152
3421736992514,8cyclictest3534521-21df12:35:142
3421736992514,8cyclictest3534521-21df12:35:142
3421736992514,7cyclictest3525187-21grep12:05:242
3421736992514,6cyclictest3469528-21ntpq09:25:192
3421731992518,4cyclictest0-21swapper/109:20:151
3421731992518,3cyclictest0-21swapper/109:10:161
3421731992517,5cyclictest0-21swapper/111:40:251
3421731992517,5cyclictest0-21swapper/110:15:261
3421731992515,6cyclictest0-21swapper/111:05:141
3421729992519,4cyclictest0-21swapper/010:45:200
3421729992511,3cyclictest131rcu_preempt08:05:150
342174099245,10cyclictest3460110-21chrt08:58:593
342174099245,10cyclictest3460110-21chrt08:58:593
3421740992414,7cyclictest3505997-21grep11:10:233
3421736992416,5cyclictest3488748-21tail10:20:242
3421736992416,5cyclictest0-21swapper/208:35:002
3421736992415,6cyclictest53-21kcompactd012:30:142
3421736992415,6cyclictest0-21swapper/211:00:182
3421736992411,8cyclictest3497325-21grep10:45:252
3421729992414,3cyclictest131rcu_preempt12:31:130
342173199234,10cyclictest0-21swapper/111:10:131
3421731992315,5cyclictest0-21swapper/110:50:261
342173199231,15cyclictest0-21swapper/108:55:131
342173199231,15cyclictest0-21swapper/108:55:131
3421731992310,11cyclictest24-21ksoftirqd/112:30:211
342173199229,6cyclictest24-21ksoftirqd/112:05:141
3421736992115,4cyclictest34344502sleep207:45:172
3421736992115,3cyclictest0-21swapper/212:30:012
3421736992114,4cyclictest0-21swapper/209:40:202
3421736992113,5cyclictest3485825-21sort10:15:012
3421736992113,5cyclictest3485825-21sort10:15:002
3421736992112,6cyclictest0-21swapper/210:55:162
342173699211,13cyclictest3526929-21head12:10:252
3421736992110,8cyclictest3473869-21sendmail09:40:002
342173699201,5cyclictest0-21swapper/212:15:232
3421736992013,5cyclictest311ktimers/211:20:032
3421736992013,4cyclictest0-21swapper/210:20:002
3421736992013,4cyclictest0-21swapper/209:10:002
3421736992012,5cyclictest0-21swapper/209:00:222
3421736992010,7cyclictest3427472-21cut07:25:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional