You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 03:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Jun 25, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3663897995845,10cyclictest311ktimers/221:10:122
3663891995645,5cyclictest231ktimers/121:55:131
3663897995539,12cyclictest311ktimers/200:05:122
3663897995338,10cyclictest311ktimers/219:50:122
3663891995136,11cyclictest231ktimers/123:05:111
3663891995037,5cyclictest3719347-21kworker/u8:1+events_unbound21:50:341
3663888994813,4cyclictest3702827-21fschecks_time21:00:160
3663897994740,5cyclictest3700591-21kworker/u8:2+events_unbound21:05:212
366388899472,5cyclictest3695542-21munin-run20:40:010
3663897994633,9cyclictest311ktimers/222:55:122
3663897994633,10cyclictest311ktimers/219:45:112
366389199451,15cyclictest24-21ksoftirqd/120:55:101
3663897994434,6cyclictest3688525-21sendmail20:20:012
366389199439,4cyclictest131rcu_preempt20:20:121
3663891994334,5cyclictest0-21swapper/122:40:011
366388899431,3cyclictest0-21swapper/020:10:150
3663888994313,25cyclictest3741774-21grep22:50:260
3663897994233,6cyclictest3727928-21unixbench_multi22:10:252
3663897994233,6cyclictest3727928-21unixbench_multi22:10:252
3663897994229,9cyclictest3722635-21grep21:55:272
3663891994235,5cyclictest3736929-21kworker/u8:0+events_unbound22:45:431
366388899424,12cyclictest13550irq/42-30be0000.ethernet23:25:110
366388899422,3cyclictest3736087-21meminfo22:35:180
3663888994215,24cyclictest3717526-21grep21:40:260
366388899421,4cyclictest3697825-21irqstats20:45:180
3663897994123,6cyclictest3667598-21kworker/u8:2+events_unbound19:18:392
366389799411,11cyclictest32-21ksoftirqd/220:50:122
366388899419,7cyclictest3694034-21sed20:35:020
366388899411,11cyclictest3690223-21apt-get20:25:080
3663900994032,5cyclictest3764820-21cron00:00:003
3663900994028,7cyclictest0-21swapper/321:35:003
3663891994030,7cyclictest231ktimers/119:45:121
366388899401,8cyclictest3688499-21cron20:20:000
3663888994011,4cyclictest3688965-21fschecks_time20:20:170
366388899401,11cyclictest3734931-21grep22:30:250
366388899400,13cyclictest0-21swapper/022:20:140
366388899400,13cyclictest0-21swapper/022:20:140
3663897993930,6cyclictest0-21swapper/219:30:012
3663897993928,7cyclictest3692127-21cron20:30:012
3663891993932,5cyclictest3700591-21kworker/u8:2+events_unbound21:10:251
366388899392,10cyclictest3666199-21wc19:15:050
366388899391,11cyclictest3763921-21ntp_states23:55:200
366388899391,11cyclictest3681842-21diskstats20:00:160
366388899391,10cyclictest3769935-21cron00:15:000
366388899391,10cyclictest3759656-21cat23:45:010
366388899391,10cyclictest3755653-21grep23:30:250
3663888993910,5cyclictest3681467-21sendmail20:00:000
3663888993910,2cyclictest0-21swapper/021:48:490
3663888993910,25cyclictest0-21swapper/019:25:010
3663897993829,6cyclictest3676358-21sh19:45:012
3663891993827,8cyclictest231ktimers/119:55:121
366388899389,3cyclictest3752756-21latency_hist23:25:010
366388899382,9cyclictest3763112-21cron23:54:590
366388899381,5cyclictest3778669-21cron00:40:000
366388899381,5cyclictest3778669-21cron00:40:000
3663888993813,3cyclictest0-21swapper/000:20:200
3663888993811,2cyclictest0-21swapper/019:30:150
3663888993811,24cyclictest0-21swapper/022:15:160
3663888993811,24cyclictest0-21swapper/022:15:160
3663888993811,24cyclictest0-21swapper/019:10:210
3663897993731,4cyclictest3693470-21kworker/u8:0+events_unbound20:40:182
3663897993728,6cyclictest3720868-21grep21:50:252
3663891993731,4cyclictest3755796-21kworker/u8:1+events_unbound23:35:531
3663891993730,5cyclictest3669339-21kworker/u8:0+events_unbound19:24:591
3663891993730,4cyclictest0-21swapper/123:50:001
3663891993729,5cyclictest3716024-21sh21:40:001
3663891993726,8cyclictest3698528-21grep20:45:261
3663891993723,10cyclictest231ktimers/121:05:121
366388899379,3cyclictest3775744-21idleruntime00:30:160
366388899377,3cyclictest3771162-21unixbench_multi00:15:250
366388899373,6cyclictest3737980-21ps22:40:210
366388899372,8cyclictest3725987-21grep22:05:230
3663888993728,6cyclictest3746952-21unixbench_singl23:05:240
366388899372,11cyclictest3711145-21apt-get21:25:100
3663888993715,2cyclictest0-21swapper/021:15:260
3663888993712,5cyclictest121ktimers/023:15:130
3663888993712,3cyclictest0-21swapper/000:30:010
366388899371,11cyclictest3705009-21wc21:05:230
366388899371,10cyclictest3677586-21tail19:45:250
3663888993710,3cyclictest645-21runrttasks23:03:260
366388899370,13cyclictest0-21swapper/021:30:180
3663900993629,3cyclictest0-21swapper/323:35:003
3663900993627,4cyclictest0-21swapper/320:40:253
3663897993626,6cyclictest0-21swapper/220:10:012
3663897993621,5cyclictest3707225-21kworker/u8:0+events_unbound21:17:432
3663891993628,6cyclictest3736929-21kworker/u8:0+events_unbound22:55:461
366388899368,6cyclictest3684480-21grep20:05:240
366388899362,12cyclictest3702363-21munin-plugin-st21:00:000
366388899361,8cyclictest3743928-21cron23:00:000
3663888993611,5cyclictest121ktimers/000:05:240
366388899361,12cyclictest3756889-21ntp_states23:35:210
3663888993611,2cyclictest0-21swapper/022:45:130
366388899361,11cyclictest3766546-21auditctl00:05:000
366388899361,11cyclictest3676374-21cut19:45:010
366388899361,11cyclictest3669882-21df19:25:130
3663888993610,6cyclictest3759747-21apt-get23:45:120
3663897993525,6cyclictest0-21swapper/223:05:242
3663897993525,6cyclictest0-21swapper/200:40:002
3663897993525,6cyclictest0-21swapper/200:40:002
3663897993524,8cyclictest3716044-21sendmail-msp21:40:002
3663891993525,6cyclictest0-21swapper/100:00:161
366388899359,3cyclictest3724770-21latency_hist22:05:010
366388899352,12cyclictest3674640-21apt19:40:020
366388899350,3cyclictest3726466-21apt-get22:10:060
366388899350,3cyclictest3726466-21apt-get22:10:050
3663900993427,4cyclictest0-21swapper/323:00:253
3663900993426,4cyclictest0-21swapper/320:35:013
3663897993426,4cyclictest0-21swapper/200:25:002
366389799340,4cyclictest131rcu_preempt21:40:132
366388899341,8cyclictest3749267-21gpgv23:15:010
3663888993412,7cyclictest0-21swapper/019:50:170
3663888993410,3cyclictest645-21runrttasks20:50:320
3663888993410,2cyclictest0-21swapper/021:50:230
3663900993324,4cyclictest0-21swapper/300:15:253
3663900993321,8cyclictest3778674-21cron00:40:003
3663900993321,8cyclictest3778674-21cron00:40:003
3663897993326,4cyclictest3765240-21fschecks_count00:00:162
3663897993324,5cyclictest3710492-21unixbench_singl21:20:232
3663897993324,5cyclictest0-21swapper/222:35:252
3663897993322,7cyclictest0-21swapper/222:35:002
3663897993317,9cyclictest131rcu_preempt23:20:422
366389799331,4cyclictest131rcu_preempt20:30:142
3663891993326,4cyclictest0-21swapper/123:40:151
3663888993311,3cyclictest0-21swapper/021:40:000
366388899331,10cyclictest3723083-21idleruntime-cro22:00:000
3663900993223,4cyclictest0-21swapper/320:55:153
3663900993222,5cyclictest0-21swapper/322:45:243
366389799322,4cyclictest131rcu_preempt23:55:102
3663897993224,4cyclictest0-21swapper/220:55:232
3663891993225,5cyclictest3707225-21kworker/u8:0+events_unbound21:32:411
366388899322,7cyclictest164-21systemd-journal21:20:240
366388899320,14cyclictest0-21swapper/022:27:410
3663900993123,4cyclictest0-21swapper/321:40:263
3663900993123,4cyclictest0-21swapper/321:10:263
3663900993120,8cyclictest3710481-21unixbench_singl21:20:233
3663891993124,5cyclictest3702333-21kworker/u8:0+events_unbound21:00:201
3663891993120,8cyclictest231ktimers/100:10:121
366389199311,9cyclictest24-21ksoftirqd/123:20:091
366389199311,4cyclictest131rcu_preempt22:00:121
3663900993022,4cyclictest3688025-21grep20:15:273
3663900993022,4cyclictest0-21swapper/323:20:133
3663900993022,4cyclictest0-21swapper/322:00:253
3663900993022,4cyclictest0-21swapper/321:45:253
3663900993022,4cyclictest0-21swapper/319:25:253
3663900993022,4cyclictest0-21swapper/319:10:253
3663900993021,5cyclictest391ktimers/320:10:133
3663897993022,4cyclictest0-21swapper/220:10:182
3663897993021,6cyclictest0-21swapper/223:50:012
3663891993023,4cyclictest0-21swapper/122:50:261
3663891993023,4cyclictest0-21swapper/121:45:161
3663891993022,4cyclictest0-21swapper/120:25:241
3663891993022,4cyclictest0-21swapper/119:35:271
366389199302,10cyclictest24-21ksoftirqd/121:40:131
366389199301,3cyclictest131rcu_preempt19:50:131
366389199300,17cyclictest24-21ksoftirqd/122:05:111
3663900992922,4cyclictest3690223-21apt-get20:25:013
3663900992921,4cyclictest0-21swapper/322:30:243
3663900992917,8cyclictest3750982-21grep23:20:003
3663900992917,7cyclictest0-21swapper/323:10:013
3663897992922,4cyclictest0-21swapper/220:25:012
3663897992921,5cyclictest0-21swapper/223:30:002
366389799291,9cyclictest37456872latency_hist23:05:012
366389199293,12cyclictest24-21ksoftirqd/121:26:061
3663891992923,4cyclictest3707225-21kworker/u8:0+events_unbound21:20:211
3663891992922,5cyclictest3649528-21kworker/u8:1+events_unbound19:15:111
3663891992921,5cyclictest3732008-21audit_send_reply22:25:011
3663891992921,5cyclictest3732008-21audit_send_reply22:25:001
3663891992921,4cyclictest0-21swapper/123:30:141
3663891992911,5cyclictest131rcu_preempt00:37:321
3663891992911,5cyclictest131rcu_preempt00:37:311
3663900992821,4cyclictest391ktimers/300:10:113
3663900992821,3cyclictest0-21swapper/319:50:263
3663900992819,4cyclictest0-21swapper/322:25:263
3663900992819,4cyclictest0-21swapper/320:30:013
3663897992821,4cyclictest0-21swapper/222:15:182
3663897992821,4cyclictest0-21swapper/222:15:172
3663897992821,4cyclictest0-21swapper/221:45:252
3663897992821,3cyclictest0-21swapper/200:20:002
3663897992820,4cyclictest0-21swapper/219:30:262
3663897992818,6cyclictest0-21swapper/222:50:262
3663897992813,9cyclictest131rcu_preempt23:40:222
3663897992813,6cyclictest3759249-21kworker/u8:2+events_unbound00:29:062
3663891992821,5cyclictest3667598-21kworker/u8:2+events_unbound19:28:191
3663891992820,6cyclictest3719347-21kworker/u8:1+events_unbound22:10:151
3663891992820,6cyclictest3719347-21kworker/u8:1+events_unbound22:10:151
3663891992820,4cyclictest0-21swapper/123:55:131
3663891992817,8cyclictest3775080-21basename00:30:001
366389199281,18cyclictest0-21swapper/120:15:371
3663900992719,5cyclictest3669074-21grep19:20:243
3663900992719,4cyclictest0-21swapper/322:15:273
3663900992719,4cyclictest0-21swapper/322:15:273
3663900992719,4cyclictest0-21swapper/322:05:243
3663900992716,7cyclictest0-21swapper/322:40:023
3663900992714,8cyclictest1-21systemd20:45:183
3663897992721,4cyclictest3759249-21kworker/u8:2+events_unbound00:11:252
3663897992721,4cyclictest3719347-21kworker/u8:1+events_unbound22:06:402
3663897992720,4cyclictest0-21swapper/223:10:252
3663897992717,6cyclictest3681457-21cron20:00:002
3663897992710,8cyclictest131rcu_preempt20:00:162
3663891992720,5cyclictest3769899-21kworker/u8:1+events_unbound00:15:141
3663891992720,5cyclictest0-21swapper/123:25:241
3663891992720,4cyclictest0-21swapper/121:20:001
3663891992719,4cyclictest0-21swapper/123:00:161
3663891992717,7cyclictest3767785-21grep00:05:231
3663900992620,4cyclictest3674401-21kworker/u8:1+events_unbound20:05:093
3663900992619,3cyclictest0-21swapper/322:10:253
3663900992619,3cyclictest0-21swapper/322:10:253
3663900992617,6cyclictest3743941-21grep23:00:003
3663900992616,6cyclictest0-21swapper/300:05:233
3663900992615,7cyclictest0-21swapper/319:35:233
3663900992615,6cyclictest0-21swapper/321:15:273
366389799269,6cyclictest0-21swapper/221:00:112
366389799268,10cyclictest32-21ksoftirqd/219:10:252
3663897992619,5cyclictest3696951-21kworker/u8:2-events_freezable_power_20:45:122
3663897992618,5cyclictest0-21swapper/220:40:022
3663897992615,8cyclictest3738553-21seq22:41:432
3663897992611,8cyclictest131rcu_preempt00:35:002
3663891992620,4cyclictest3684508-21kworker/u8:2+events_unbound20:10:261
3663891992619,5cyclictest3755796-21kworker/u8:1+events_unbound23:52:561
3663891992619,4cyclictest0-21swapper/120:05:001
3663891992610,6cyclictest24-21ksoftirqd/122:40:191
3663891992610,6cyclictest24-21ksoftirqd/120:40:141
366390099252,12cyclictest3695094-21tail20:35:253
3663900992519,4cyclictest3649528-21kworker/u8:1+events_unbound19:19:433
3663900992518,4cyclictest3712217-21grep21:25:263
3663900992517,4cyclictest0-21swapper/323:40:243
3663900992516,6cyclictest3775063-21sh00:30:013
366389799256,12cyclictest32-21ksoftirqd/222:25:262
3663897992517,4cyclictest0-21swapper/223:30:142
3663897992517,4cyclictest0-21swapper/222:00:182
3663897992514,7cyclictest3713870-21grep21:30:252
3663897992511,8cyclictest131rcu_preempt22:20:232
3663897992511,8cyclictest131rcu_preempt22:20:232
366389199259,6cyclictest24-21ksoftirqd/120:50:191
366389199256,9cyclictest24-21ksoftirqd/120:05:141
3663900992418,3cyclictest0-21swapper/300:00:223
3663900992417,3cyclictest0-21swapper/320:05:013
3663900992416,4cyclictest0-21swapper/319:55:183
3663900992414,6cyclictest0-21swapper/319:50:013
3663897992418,3cyclictest0-21swapper/223:50:152
3663897992414,7cyclictest3669195-21seq19:20:572
366389199249,5cyclictest24-21ksoftirqd/123:15:051
366389199247,6cyclictest24-21ksoftirqd/119:40:121
3663891992418,4cyclictest3748689-21kworker/u8:3+events_unbound23:11:121
3663891992417,5cyclictest3769899-21kworker/u8:1+events_unbound00:30:051
3663891992413,7cyclictest3693385-21grep20:30:261
366389199241,12cyclictest0-21swapper/120:38:271
366388899241,19cyclictest0-21swapper/021:14:520
3663900992317,3cyclictest0-21swapper/323:50:213
3663900992314,6cyclictest391ktimers/321:50:223
3663900992314,5cyclictest0-21swapper/319:45:013
366389799235,3cyclictest131rcu_preempt23:35:112
3663897992315,6cyclictest3748665-21kworker/u8:2+events_unbound23:15:042
366389199234,3cyclictest131rcu_preempt19:10:181
366389199234,11cyclictest0-21swapper/122:30:131
3663891992316,5cyclictest3769899-21kworker/u8:1+events_unbound00:20:101
3663891992316,5cyclictest3649528-21kworker/u8:1+events_unbound19:31:441
3663891992314,6cyclictest0-21swapper/122:20:001
3663891992314,6cyclictest0-21swapper/122:20:001
366390099228,2cyclictest131rcu_preempt21:55:133
3663900992216,3cyclictest0-21swapper/319:30:153
3663900992214,4cyclictest3705778-21sh21:10:003
3663900992214,4cyclictest0-21swapper/323:45:163
3663900992115,4cyclictest391ktimers/320:52:353
3663900992115,3cyclictest0-21swapper/322:40:173
3663900992114,3cyclictest0-21swapper/300:35:003
3663900992110,7cyclictest0-21swapper/323:15:003
3663900992012,4cyclictest0-21swapper/300:20:133
3663900992011,6cyclictest3716190-21latency_hist21:40:013
366390099201,14cyclictest3704072-21cron21:05:003
3663900992010,7cyclictest1-21systemd22:50:433
3663900991913,3cyclictest0-21swapper/322:20:233
3663900991913,3cyclictest0-21swapper/322:20:233
3663900991911,4cyclictest3757817-21sendmail23:40:003
3663900991910,5cyclictest391ktimers/323:30:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional