You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 12:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Aug 08, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3334530995629,23cyclictest0-21swapper/023:45:000
3334530995514,23cyclictest0-21swapper/022:40:250
3334538995042,4cyclictest3358944-21munin-plugin-st20:20:002
3334538994841,4cyclictest3352118-21cron20:00:002
3334542994637,5cyclictest3399681-21runrttasks22:15:273
3334542994634,8cyclictest391ktimers/322:20:143
3334538994536,6cyclictest311ktimers/220:55:122
3334538994432,8cyclictest3441604-21grep00:20:002
333453099442,5cyclictest3436697-21df00:05:120
333453099442,10cyclictest3335742-21unixbench_singl19:10:260
333453099441,6cyclictest3354626-21ntp_states20:05:220
333453099431,10cyclictest3404334-21/usr/sbin/munin22:30:180
3334542994231,7cyclictest3340183-21sh19:25:013
333453099422,11cyclictest3386704-21apt-get21:40:110
333453099421,8cyclictest3433728-21/usr/sbin/munin23:55:200
333453099421,3cyclictest3429772-21apt-get23:45:140
333453099421,10cyclictest3355815-21/usr/sbin/munin20:10:130
3334530994210,29cyclictest3337824-21sed19:15:260
3334533994133,5cyclictest3374508-21cron21:05:001
3334533994133,5cyclictest3374508-21cron21:05:001
333453099411,9cyclictest3435896-21grep00:00:280
333453099411,9cyclictest3364502-21/usr/sbin/munin20:35:120
3334530994119,19cyclictest0-21swapper/021:00:130
3334530994119,19cyclictest0-21swapper/021:00:130
333453099411,8cyclictest3443434-21munin-node00:25:100
3334542994029,6cyclictest0-21swapper/322:00:253
333453099402,7cyclictest3421113-21latency_hist23:20:010
333453099402,3cyclictest3438300-21apt-get00:10:120
333453099402,3cyclictest3438300-21apt-get00:10:120
333453099401,9cyclictest3441789-21/usr/sbin/munin00:20:130
333453099401,9cyclictest3417934-21df_inode23:10:130
333453099401,9cyclictest3341329-21/usr/sbin/munin19:25:250
333453099401,8cyclictest3369929-21/usr/sbin/munin20:50:170
333453099401,7cyclictest3394823-21cron22:03:000
333453099401,4cyclictest3414420-21apt-get23:00:120
333453099401,3cyclictest3369280-21sshd20:48:430
333453099401,3cyclictest0-21swapper/022:20:010
3334530994012,25cyclictest3402365-21if_eth122:25:160
333453099401,10cyclictest3421250-21/usr/sbin/munin23:20:120
333453099401,10cyclictest3397047-21/usr/sbin/munin22:10:150
3334538993928,7cyclictest3394571-21grep22:00:262
333453099393,4cyclictest3390656-21/usr/sbin/munin21:50:200
333453099391,8cyclictest3385665-21/usr/sbin/munin21:35:240
333453099391,7cyclictest3426504-21/usr/sbin/munin23:35:150
333453099391,7cyclictest3363870-21/usr/sbin/munin20:30:260
333453099391,6cyclictest3411664-21/usr/sbin/munin22:50:210
333453099391,6cyclictest3352603-21/usr/sbin/munin20:00:160
333453099391,5cyclictest3383386-21df21:30:130
3334530993914,20cyclictest0-21swapper/023:50:240
333453099391,11cyclictest3446291-21chrt00:31:070
333453099391,11cyclictest3406884-21tail22:35:240
333453099391,11cyclictest3371807-21/usr/sbin/munin20:55:220
333453099390,7cyclictest3423035-21cstates23:25:130
333453099390,7cyclictest3409995-21/usr/sbin/munin22:45:230
333453099390,7cyclictest3409995-21/usr/sbin/munin22:45:230
333453099390,10cyclictest3347362-21diskstats19:45:160
3334542993827,8cyclictest3372796-21apt21:00:003
333453099383,30cyclictest3391920-21df_inode21:55:140
333453099382,4cyclictest3447976-21/usr/sbin/munin00:35:260
333453099382,3cyclictest3378401-21/usr/sbin/munin21:15:170
333453099382,33cyclictest3413974-21sshd22:57:430
333453099381,6cyclictest3395360-21/usr/sbin/munin22:05:150
333453099381,6cyclictest3366255-21cpu20:40:130
333453099381,5cyclictest3381916-21irqstats21:25:170
333453099381,5cyclictest3361435-21irqstats20:25:190
333453099381,5cyclictest3345535-21/usr/sbin/munin19:40:090
333453099381,4cyclictest3343822-21/usr/sbin/munin19:35:110
333453099381,3cyclictest3388407-21apt-get21:45:130
333453099381,3cyclictest0-21swapper/000:20:010
333453099381,11cyclictest3352142-21idleruntime-cro20:00:000
333453099381,10cyclictest3375311-21ntp_states21:05:210
333453099380,7cyclictest3424761-21diskstats23:30:130
3334542993727,6cyclictest3391567-21cron21:55:003
3334542993726,7cyclictest164-21systemd-journal20:06:423
3334538993726,7cyclictest3340182-21cron19:25:012
3334538993725,9cyclictest311ktimers/200:00:122
333453099373,3cyclictest3358163-21/usr/sbin/munin20:15:250
333453099371,9cyclictest3348940-21apt-get19:50:120
333453099371,5cyclictest3400983-21/usr/sbin/munin22:20:240
333453099371,5cyclictest3380603-21/usr/sbin/munin21:20:240
333453099371,4cyclictest3376562-21df21:10:130
333453099371,4cyclictest3359189-21apt-get20:20:130
333453099371,34cyclictest3417393-21sshd23:07:430
3334538993627,6cyclictest3344888-21grep19:35:252
333453099368,25cyclictest3342493-21latency19:30:190
333453099361,5cyclictest3338719-21apt-get19:20:120
3334542993527,5cyclictest0-21swapper/319:20:003
3334542993527,4cyclictest0-21swapper/322:35:143
3334542993527,4cyclictest0-21swapper/300:25:193
3334542993521,8cyclictest0-21swapper/300:20:003
3334538993528,3cyclictest0-21swapper/223:00:002
3334538993526,6cyclictest0-21swapper/200:00:002
3334538993524,7cyclictest3384264-21grep21:30:242
3334533993527,5cyclictest3369391-21auditctl20:50:011
3334533993526,5cyclictest0-21swapper/122:25:001
3334533993526,4cyclictest0-21swapper/123:20:161
3334542993428,3cyclictest3421006-21sendmail23:20:003
3334542993426,4cyclictest0-21swapper/320:15:273
3334542993424,6cyclictest0-21swapper/319:45:013
3334538993426,5cyclictest3446214-21unixbench_singl00:30:272
3334538993425,6cyclictest3432931-21sh23:55:002
3334538993422,9cyclictest311ktimers/220:30:132
3334542993325,5cyclictest0-21swapper/300:35:003
3334542993324,5cyclictest0-21swapper/320:25:003
3334538993322,7cyclictest3368974-21grep20:45:262
3334533993324,5cyclictest0-21swapper/122:10:241
3334533993324,5cyclictest0-21swapper/120:00:241
3334533993324,4cyclictest0-21swapper/122:25:241
3334533993323,7cyclictest3448537-21sendmail00:40:011
3334542993222,7cyclictest0-21swapper/321:20:013
3334542993222,6cyclictest3413764-21grep22:55:243
3334538993226,3cyclictest0-21swapper/220:25:002
3334538993223,5cyclictest3431230-21sh23:50:002
3334538993222,5cyclictest0-21swapper/221:06:522
3334538993219,10cyclictest311ktimers/222:35:112
3334538993218,11cyclictest311ktimers/219:15:152
3334542993123,5cyclictest0-21swapper/320:30:013
3334538993124,3cyclictest0-21swapper/221:05:012
3334538993124,3cyclictest0-21swapper/221:05:002
3334538993121,6cyclictest3353828-21sh20:05:002
3334533993123,5cyclictest0-21swapper/120:50:261
3334533993123,4cyclictest0-21swapper/120:30:011
3334533993122,5cyclictest0-21swapper/100:10:001
3334533993121,7cyclictest0-21swapper/120:35:171
3334542993022,4cyclictest0-21swapper/320:40:003
3334542993021,6cyclictest3343586-21sh19:35:013
3334542993021,5cyclictest0-21swapper/323:35:153
3334542993021,5cyclictest0-21swapper/300:05:243
3334538993023,3cyclictest0-21swapper/223:20:012
3334538993020,6cyclictest0-21swapper/220:55:002
3334538993020,5cyclictest0-21swapper/221:55:002
3334533993020,6cyclictest3396696-21auditctl22:10:011
3334533993020,6cyclictest0-21swapper/100:20:001
3334533993018,8cyclictest3421013-21sendmail23:20:001
3334542992923,3cyclictest0-21swapper/321:40:013
3334542992922,4cyclictest0-21swapper/321:45:003
3334542992921,4cyclictest0-21swapper/323:10:243
3334542992921,4cyclictest0-21swapper/320:40:253
3334542992918,7cyclictest3423963-21grep23:25:233
3334542992918,7cyclictest3384744-21sh21:35:003
333453899297,4cyclictest33564352rt-features20:10:242
3334538992921,4cyclictest0-21swapper/222:35:012
3334538992921,4cyclictest0-21swapper/222:25:162
3334538992921,4cyclictest0-21swapper/221:15:252
3334533992921,4cyclictest0-21swapper/122:40:001
3334533992921,4cyclictest0-21swapper/119:10:251
3334533992920,6cyclictest0-21swapper/123:15:001
3334533992920,6cyclictest0-21swapper/120:25:011
3334533992919,6cyclictest0-21swapper/121:55:001
3334542992822,3cyclictest0-21swapper/300:15:003
3334542992822,3cyclictest0-21swapper/300:15:003
3334542992821,4cyclictest0-21swapper/322:30:003
3334542992819,5cyclictest0-21swapper/321:00:273
3334542992819,5cyclictest0-21swapper/321:00:263
3334542992819,4cyclictest0-21swapper/323:40:163
3334542992819,4cyclictest0-21swapper/319:35:263
3334542992817,7cyclictest3392844-21grep21:55:253
3334538992822,3cyclictest0-21swapper/200:35:272
3334538992821,4cyclictest0-21swapper/223:10:252
3334538992820,6cyclictest3361293-21fschecks_time20:25:162
3334538992820,5cyclictest3439302-21tail00:10:242
3334538992820,5cyclictest3439302-21tail00:10:242
3334538992818,5cyclictest0-21swapper/220:35:272
3334538992817,8cyclictest3408607-21grep22:40:242
3334538992817,6cyclictest0-21swapper/221:55:262
3334533992822,3cyclictest0-21swapper/121:40:241
333453399281,24cyclictest3343186-21grep19:30:251
3334542992719,4cyclictest0-21swapper/320:00:243
3334542992716,7cyclictest3348281-21grep19:45:273
3334542992713,6cyclictest3410366-21uptime22:45:253
3334542992713,6cyclictest3410366-21uptime22:45:253
3334538992720,3cyclictest0-21swapper/221:40:012
3334538992718,5cyclictest3335701-21grep19:10:242
3334538992718,5cyclictest0-21swapper/222:10:242
3334538992717,7cyclictest3444493-21grep00:25:252
3334538992717,7cyclictest3347397-21fschecks_count19:45:182
3334538992717,6cyclictest0-21swapper/223:20:252
3334533992720,4cyclictest0-21swapper/121:45:251
3334533992719,4cyclictest0-21swapper/121:20:261
3334533992718,6cyclictest0-21swapper/119:55:251
3334533992716,3cyclictest0-21swapper/123:05:241
3334542992618,6cyclictest3424229-21kworker/u8:1+events_unbound23:32:173
3334542992615,7cyclictest0-21swapper/319:30:013
3334542992615,7cyclictest0-21swapper/300:35:273
3334538992620,3cyclictest0-21swapper/223:40:002
3334538992620,3cyclictest0-21swapper/223:05:222
333453399263,4cyclictest3398765-21grep22:15:161
3334533992619,4cyclictest0-21swapper/100:10:161
3334533992619,4cyclictest0-21swapper/100:10:151
3334533992619,3cyclictest3409396-21cstates22:45:131
3334533992619,3cyclictest3409396-21cstates22:45:131
3334533992618,5cyclictest0-21swapper/100:20:251
3334533992618,4cyclictest0-21swapper/119:20:001
3334533992617,6cyclictest0-21swapper/121:25:161
3334533992617,5cyclictest0-21swapper/123:50:241
3334533992616,5cyclictest3446611-21cron00:35:001
333453399261,16cyclictest0-21swapper/119:21:091
3334542992518,3cyclictest0-21swapper/323:20:203
3334542992518,3cyclictest0-21swapper/322:10:223
3334542992517,4cyclictest0-21swapper/323:55:153
3334542992516,6cyclictest0-21swapper/300:05:003
3334542992516,5cyclictest0-21swapper/322:40:243
3334538992519,3cyclictest0-21swapper/222:50:152
3334538992518,4cyclictest0-21swapper/222:15:212
3334538992516,5cyclictest3367225-21grep20:40:262
3334533992519,3cyclictest0-21swapper/100:00:261
3334533992518,3cyclictest0-21swapper/121:35:181
3334533992516,5cyclictest0-21swapper/123:00:241
3334542992418,3cyclictest0-21swapper/321:25:233
3334542992417,5cyclictest391ktimers/319:50:123
3334542992417,3cyclictest0-21swapper/320:10:133
3334542992417,3cyclictest0-21swapper/319:55:153
3334542992413,8cyclictest3431713-21basename23:50:153
3334538992418,3cyclictest0-21swapper/200:09:512
3334538992416,5cyclictest0-21swapper/221:25:172
333453399247,4cyclictest131rcu_preempt21:15:141
3334533992418,3cyclictest0-21swapper/119:50:201
3334533992417,4cyclictest0-21swapper/123:30:151
3334533992415,5cyclictest0-21swapper/120:35:001
3334542992317,3cyclictest0-21swapper/323:45:233
3334542992317,3cyclictest0-21swapper/320:30:273
3334542992316,3cyclictest0-21swapper/321:50:023
3334542992314,7cyclictest3334523-21cyclictest22:08:453
3334542992314,6cyclictest0-21swapper/323:05:013
3334542992313,7cyclictest3443177-21seq00:24:493
3334542992313,7cyclictest3416555-21date23:05:193
3334542992313,7cyclictest3368817-21cat20:45:253
3334542992312,6cyclictest3404425-21sort22:30:193
3334538992317,3cyclictest0-21swapper/221:45:252
3334538992315,4cyclictest438-21cron22:25:002
3334538992313,8cyclictest3423113-21cut23:25:142
3334533992318,3cyclictest0-21swapper/119:45:241
3334533992317,3cyclictest0-21swapper/121:10:161
3334533992317,3cyclictest0-21swapper/100:25:201
3334533992315,5cyclictest0-21swapper/121:30:241
3334533992315,4cyclictest0-21swapper/122:50:251
3334533992314,6cyclictest0-21swapper/120:05:171
3334542992217,3cyclictest34111242sleep322:50:153
3334542992216,3cyclictest0-21swapper/319:10:143
3334542992215,5cyclictest3374411-21kworker/u8:1+events_unbound21:06:513
3334542992213,6cyclictest0-21swapper/321:20:203
333453899222,16cyclictest645-21runrttasks19:25:122
333453899222,13cyclictest3428281-21fschecks_time23:40:172
3334538992217,3cyclictest0-21swapper/220:10:002
3334538992216,4cyclictest0-21swapper/222:10:012
3334538992211,8cyclictest3425718-21users23:30:242
333453899221,15cyclictest3415479-21unixbench_singl23:00:242
3334533992216,3cyclictest0-21swapper/119:40:201
3334533992215,3cyclictest0-21swapper/119:25:211
3334533992214,4cyclictest0-21swapper/123:45:001
3334533992212,7cyclictest3392809-21grep21:55:251
3334533992212,6cyclictest0-21swapper/121:10:001
333453399221,13cyclictest0-21swapper/123:46:331
333453399221,13cyclictest0-21swapper/122:04:401
333453899212,14cyclictest3410759-21cron22:50:012
333453899212,14cyclictest3410759-21cron22:50:002
3334538992112,6cyclictest3342206-21sort19:30:132
3334538992112,6cyclictest0-21swapper/200:20:132
333453899211,16cyclictest3349950-21tail19:50:252
3334533992115,3cyclictest3358942-21sh20:20:001
3334533992114,5cyclictest164-21systemd-journal22:30:411
3334533992114,3cyclictest0-21swapper/121:00:001
3334533992114,3cyclictest0-21swapper/120:40:251
3334533992112,6cyclictest0-21swapper/123:25:161
3334538992012,5cyclictest3377236-21ls21:10:232
3334538992011,6cyclictest0-21swapper/221:20:142
3334533992013,4cyclictest0-21swapper/120:13:521
3334533992010,7cyclictest3408224-21ps22:40:211
3334533991914,3cyclictest3433163-21/usr/sbin/munin23:55:171
3334533991913,3cyclictest0-21swapper/123:35:231
3334533991911,5cyclictest0-21swapper/119:35:161
3334533991813,3cyclictest3412697-21/usr/sbin/munin22:55:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional