You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 06:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat May 09, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
66788995237,11cyclictest311ktimers/222:05:122
66784995037,9cyclictest231ktimers/100:20:111
66784994936,10cyclictest231ktimers/121:00:131
66793994739,5cyclictest160648-21unixbench_singl23:35:223
66793994739,5cyclictest160648-21unixbench_singl23:35:223
66793994738,6cyclictest156449-21cut23:25:153
6677999470,44cyclictest115557-21latency_hist21:30:000
66788994633,9cyclictest62661-21kworker/u8:3-ext4-rsv-conversion19:20:012
66779994625,17cyclictest0-21swapper/000:34:590
66788994534,7cyclictest0-21swapper/221:00:012
6677999453,10cyclictest155742-21sshd23:22:140
66779994519,22cyclictest0-21swapper/021:05:010
66784994435,6cyclictest122953-21munin-plugin-st21:50:001
6677999431,11cyclictest92487-21unixbench_singl20:20:270
6677999431,10cyclictest151755-21/usr/sbin/munin23:10:240
66784994233,4cyclictest0-21swapper/119:57:181
6677999422,3cyclictest0-21swapper/021:05:110
6677999421,9cyclictest172160-21/usr/sbin/munin00:10:210
6677999421,6cyclictest85552-21timerwakeupswit20:00:240
66788994133,4cyclictest156450-21runrttasks23:25:152
6677999411,9cyclictest180738-21/usr/sbin/munin00:35:190
6677999411,9cyclictest170146-21/usr/sbin/munin00:05:160
6677999411,9cyclictest149463-21/usr/sbin/munin23:05:160
6677999411,8cyclictest168781-21/usr/sbin/munin00:00:220
6677999411,7cyclictest161443-21/usr/sbin/munin23:40:140
6677999411,5cyclictest166787-21/usr/sbin/munin23:55:170
6677999411,10cyclictest86444-21/usr/sbin/munin20:05:150
6677999411,10cyclictest160621-21sed23:35:230
6677999411,10cyclictest160621-21sed23:35:220
66793994032,4cyclictest70745-21sendmail19:20:003
66788994034,4cyclictest115448-21kworker/u8:1+events_unbound21:37:332
66784994032,5cyclictest121195-21latency_hist21:45:011
6677999403,5cyclictest102225-21ntp_states20:50:210
6677999403,4cyclictest163036-21apt-get23:45:120
6677999402,6cyclictest99259-21grep20:40:250
6677999402,6cyclictest121595-21df_inode21:45:140
66779994019,19cyclictest0-21swapper/022:50:130
6677999401,8cyclictest177194-21/usr/sbin/munin00:25:150
6677999401,7cyclictest175957-21/usr/sbin/munin00:20:240
6677999401,6cyclictest173916-21meminfo00:15:190
6677999401,5cyclictest13550irq/42-30be0000.ethernet21:40:120
6677999401,5cyclictest131192-21/usr/sbin/munin22:10:240
66793993932,4cyclictest110240-21apt-config21:15:013
66793993931,5cyclictest94155-21unixbench_multi20:25:253
66793993931,5cyclictest94155-21unixbench_multi20:25:253
66793993926,10cyclictest391ktimers/321:15:133
6677999393,7cyclictest111863-21sshd21:17:300
6677999392,4cyclictest133839-21apt-get22:20:110
6677999392,12cyclictest68405-21cron19:15:010
6677999392,12cyclictest68405-21cron19:15:010
6677999391,9cyclictest77302-21sshd19:37:140
6677999391,9cyclictest108970-21/usr/sbin/munin21:10:160
6677999391,8cyclictest69622-21/usr/sbin/munin19:15:160
6677999391,8cyclictest143183-21sed22:45:230
6677999391,7cyclictest137376-21/usr/sbin/munin22:30:160
6677999391,6cyclictest89823-21df_inode20:15:130
6677999391,6cyclictest72668-21/usr/sbin/munin19:25:250
6677999391,5cyclictest95283-21meminfo20:30:180
6677999391,3cyclictest126717-21wc22:00:010
66779993912,24cyclictest154104-21latency_hist23:20:010
66784993831,4cyclictest119128-21idleruntime-cro21:40:011
6677999383,3cyclictest147593-21df23:00:140
6677999382,4cyclictest156214-21/usr/sbin/munin23:25:100
6677999381,9cyclictest88388-21/usr/sbin/munin20:10:170
6677999381,9cyclictest146741-21unixbench_multi22:55:250
6677999381,7cyclictest82985-21awk19:55:140
6677999381,7cyclictest137025-21idleruntime-cro22:30:010
6677999381,5cyclictest140581-21sed22:40:010
6677999381,3cyclictest118714-21/usr/sbin/munin21:35:250
6677999381,11cyclictest103472-21df_inode20:55:140
6677999381,10cyclictest165114-21grep23:50:190
66793993727,7cyclictest86083-21idleruntime-cro20:05:013
66784993727,6cyclictest0-21swapper/100:35:161
6677999379,25cyclictest127050-21/usr/sbin/munin22:00:170
6677999371,9cyclictest123952-21ntp_states21:50:190
6677999371,9cyclictest123952-21ntp_states21:50:190
6677999371,8cyclictest74611-21/usr/sbin/munin19:30:170
6677999371,4cyclictest79019-21sshd19:42:130
6677999371,4cyclictest71061-21cstates19:20:130
6677999371,4cyclictest116065-21irqstats21:30:170
6677999371,3cyclictest99952-21/usr/sbin/munin20:45:110
6677999371,3cyclictest141411-21/usr/sbin/munin22:40:210
6677999371,3cyclictest141411-21/usr/sbin/munin22:40:200
6677999371,10cyclictest157916-21apt-get23:30:130
66779993710,23cyclictest0-21swapper/020:35:230
6677999370,9cyclictest93136-21apt-get20:25:110
6677999370,9cyclictest93136-21apt-get20:25:110
66793993627,6cyclictest391ktimers/323:30:123
66793993627,4cyclictest0-21swapper/322:25:153
66793993625,7cyclictest146809-21grep22:55:253
66793993624,8cyclictest0-21swapper/320:00:013
66788993625,7cyclictest75852-21grep19:35:002
66788993625,6cyclictest0-21swapper/220:00:252
6677999362,9cyclictest112323-21/usr/sbin/munin21:20:090
6677999361,9cyclictest80060-21ntp_states19:45:210
6677999361,6cyclictest81359-21fschecks_count19:50:160
6677999361,3cyclictest128630-21diskstats22:05:150
66793993527,4cyclictest0-21swapper/319:45:163
66788993527,5cyclictest112542-21fschecks_time21:20:142
66788993527,4cyclictest110156-21sh21:15:002
66784993524,7cyclictest102657-21grep20:50:231
6677999351,3cyclictest131675-21apt-get22:15:050
66788993427,4cyclictest97998-21cron20:40:002
66788993427,4cyclictest0-21swapper/200:10:142
66788993426,4cyclictest0-21swapper/223:55:162
66788993426,4cyclictest0-21swapper/221:02:292
66793993325,5cyclictest151921-21unixbench_singl23:10:243
66793993325,5cyclictest145099-21grep22:50:243
66793993325,4cyclictest0-21swapper/321:55:253
66793993324,6cyclictest0-21swapper/321:05:003
6679399332,27cyclictest68421-21ls19:15:013
6679399332,27cyclictest68421-21ls19:15:013
66788993326,3cyclictest0-21swapper/222:20:152
66788993323,6cyclictest0-21swapper/220:55:012
66788993321,9cyclictest311ktimers/219:20:132
66784993326,4cyclictest67157-21fschecks_time19:10:151
66784993326,4cyclictest67157-21fschecks_time19:10:151
66784993324,4cyclictest0-21swapper/123:35:231
66784993324,4cyclictest0-21swapper/123:35:231
66784993322,7cyclictest0-21swapper/120:45:251
66793993223,6cyclictest143356-21grep22:45:233
66793993223,4cyclictest0-21swapper/300:15:013
66793993222,6cyclictest0-21swapper/321:20:233
66788993224,6cyclictest95408-21kworker/u8:2+events_unbound21:45:052
66788993223,5cyclictest163563-21grep23:45:202
66784993223,6cyclictest150194-21unixbench_multi23:05:281
66793993123,4cyclictest0-21swapper/321:35:243
66793993123,4cyclictest0-21swapper/320:40:243
66788993124,3cyclictest0-21swapper/200:19:592
66788993123,5cyclictest0-21swapper/220:44:592
66788993123,4cyclictest154086-21idleruntime-cro23:20:002
66784993124,4cyclictest145945-21runrttasks22:55:141
66784993124,4cyclictest0-21swapper/121:20:231
66784993124,4cyclictest0-21swapper/120:30:261
66784993123,5cyclictest0-21swapper/121:15:251
66784993123,4cyclictest0-21swapper/121:25:161
6679399309,4cyclictest131rcu_preempt21:00:003
66793993022,5cyclictest0-21swapper/323:55:013
66793993022,5cyclictest0-21swapper/321:45:013
66793993021,5cyclictest0-21swapper/322:15:013
66793993020,7cyclictest95067-21grep20:30:153
66788993023,3cyclictest0-21swapper/220:20:012
66788993022,3cyclictest0-21swapper/221:30:242
66788993021,6cyclictest311ktimers/221:55:092
66784993023,4cyclictest0-21swapper/120:40:251
66784993021,6cyclictest135311-21kthreadd22:25:011
66784993021,5cyclictest0-21swapper/123:45:241
66784993020,7cyclictest231ktimers/100:15:111
66793992922,4cyclictest0-21swapper/321:45:263
66793992921,4cyclictest0-21swapper/322:15:243
66793992921,4cyclictest0-21swapper/300:25:233
6679399291,4cyclictest131rcu_preempt22:35:133
66788992923,3cyclictest0-21swapper/219:55:002
66788992922,3cyclictest0-21swapper/200:00:262
66788992921,4cyclictest0-21swapper/221:55:002
66788992921,4cyclictest0-21swapper/221:55:002
66788992920,7cyclictest76064-21kworker/u8:3+events_unbound19:47:172
66793992822,4cyclictest167919-21idleruntime-cro00:00:013
66793992820,5cyclictest0-21swapper/319:40:013
66793992820,4cyclictest0-21swapper/323:45:253
66784992821,4cyclictest0-21swapper/123:40:251
66784992821,4cyclictest0-21swapper/122:05:241
66784992820,4cyclictest0-21swapper/122:40:231
66784992820,4cyclictest0-21swapper/122:40:231
66784992818,7cyclictest131202-21grep22:10:231
66784992817,7cyclictest0-21swapper/121:55:001
66784992817,7cyclictest0-21swapper/121:55:001
66784992816,7cyclictest0-21swapper/119:45:211
66784992816,10cyclictest66770-21cyclictest20:15:121
66793992717,7cyclictest81252-21ls19:50:143
66793992717,7cyclictest0-21swapper/323:20:013
66793992717,6cyclictest208-21systemd-logind20:17:223
66793992716,8cyclictest128509-21apt-get22:05:113
6678899279,4cyclictest131rcu_preempt21:05:242
66788992719,4cyclictest0-21swapper/222:35:252
66788992718,6cyclictest176259-21grep00:20:262
66788992718,4cyclictest0-21swapper/223:50:252
66784992720,5cyclictest160826-21kworker/u8:0+events_unbound00:08:261
66784992718,5cyclictest0-21swapper/122:30:251
66784992717,7cyclictest158121-21tune2fs23:30:171
66784992714,10cyclictest178350-21cron00:30:001
66793992620,4cyclictest78831-21unixbench_singl19:40:253
66793992620,3cyclictest0-21swapper/300:30:163
66793992619,3cyclictest0-21swapper/319:20:243
66793992617,5cyclictest0-21swapper/322:30:153
66793992616,6cyclictest0-21swapper/322:05:003
66793992615,8cyclictest181782-21basename00:40:003
66788992620,3cyclictest0-21swapper/221:40:252
66788992617,6cyclictest0-21swapper/200:39:592
66788992617,4cyclictest0-21swapper/219:40:252
66788992615,7cyclictest133112-21grep22:15:242
66784992619,4cyclictest0-21swapper/120:35:241
66784992615,8cyclictest204-21dbus-daemon22:47:461
66784992612,11cyclictest66770-21cyclictest21:55:101
66793992517,5cyclictest0-21swapper/320:05:163
66793992515,7cyclictest92691-21seq20:22:293
66788992517,6cyclictest153907-21kworker/u8:1+events_unbound23:44:412
66788992515,7cyclictest149781-21awk23:05:252
66788992515,6cyclictest0-21swapper/200:25:242
66784992517,4cyclictest0-21swapper/121:10:231
66784992517,4cyclictest0-21swapper/121:00:011
66784992517,4cyclictest0-21swapper/119:35:231
66784992516,6cyclictest0-21swapper/119:20:011
66793992417,4cyclictest0-21swapper/300:05:253
66793992417,3cyclictest0-21swapper/323:00:213
66793992414,7cyclictest88117-21df20:10:133
66793992413,8cyclictest73973-21seq19:28:023
66788992417,5cyclictest124797-21kworker/u8:1+events_unbound22:30:082
66788992417,4cyclictest0-21swapper/223:10:252
66788992416,5cyclictest159375-21cron23:35:002
66788992415,7cyclictest145393-21kworker/u8:3+events_unbound22:53:512
66784992418,3cyclictest0-21swapper/119:50:211
66784992416,4cyclictest0-21swapper/119:25:261
66784992414,7cyclictest0-21swapper/121:10:011
66784992414,6cyclictest173023-21apt-get00:15:011
66793992318,3cyclictest0-21swapper/321:50:143
66793992318,3cyclictest0-21swapper/321:50:133
66793992317,3cyclictest0-21swapper/323:20:133
66793992317,3cyclictest0-21swapper/321:25:153
66793992317,3cyclictest0-21swapper/320:35:193
66793992317,3cyclictest0-21swapper/300:15:163
66793992317,3cyclictest0-21swapper/300:00:183
66793992315,4cyclictest0-21swapper/321:35:003
66793992313,7cyclictest142185-21cut22:45:003
66793992313,7cyclictest142185-21cut22:45:003
66788992317,3cyclictest0-21swapper/222:45:162
66788992317,3cyclictest0-21swapper/222:02:362
66788992315,5cyclictest0-21swapper/221:30:012
66788992314,5cyclictest0-21swapper/220:45:232
66788992313,6cyclictest0-21swapper/223:35:212
66788992313,6cyclictest0-21swapper/223:35:202
6678499232,11cyclictest0-21swapper/119:41:271
66784992317,4cyclictest89492-21munin-plugin-st20:15:011
66784992317,3cyclictest0-21swapper/123:15:011
66784992317,3cyclictest0-21swapper/100:00:161
66784992316,4cyclictest0-21swapper/120:25:011
66784992316,3cyclictest0-21swapper/100:35:011
66784992312,8cyclictest144270-21cut22:50:151
6679399226,13cyclictest381rcuc/320:50:133
66793992216,3cyclictest0-21swapper/319:30:263
66793992211,7cyclictest101575-21cut20:50:023
66788992216,4cyclictest137381-21kworker/u8:0+events_unbound22:57:482
66788992216,4cyclictest126355-21kworker/u8:3+events_unbound22:11:172
66788992216,3cyclictest0-21swapper/200:30:262
66788992216,3cyclictest0-21swapper/200:10:002
6678899220,4cyclictest0-21swapper/219:55:232
66784992216,3cyclictest0-21swapper/123:50:141
66784992213,6cyclictest0-21swapper/119:30:171
66784992212,6cyclictest133151-21grep22:15:251
66793992112,7cyclictest145-21jbd2/mmcblk1p2-800:20:063
66788992115,3cyclictest0-21swapper/220:25:222
66788992115,3cyclictest0-21swapper/220:25:212
66788992114,4cyclictest89047-21grep20:10:252
66788992113,5cyclictest311ktimers/223:20:302
66788992113,5cyclictest0-21swapper/220:20:252
66788992113,4cyclictest67132-21grep19:10:162
66788992113,4cyclictest67132-21grep19:10:162
66788992111,7cyclictest111178-21ntp_states21:15:232
66784992115,3cyclictest0-21swapper/120:30:001
66784992115,3cyclictest0-21swapper/120:30:001
66784992114,3cyclictest0-21swapper/122:39:591
66784992113,5cyclictest0-21swapper/123:00:251
6678899209,7cyclictest164-21systemd-journal23:02:482
66788992014,4cyclictest311ktimers/220:30:252
66788992013,5cyclictest0-21swapper/220:10:012
66788992013,3cyclictest0-21swapper/222:25:182
66784992015,3cyclictest154995-21missed_timers23:20:171
66784992013,4cyclictest231ktimers/122:03:341
66784992013,4cyclictest117356-21apt-key21:35:021
66784992011,6cyclictest0-21swapper/119:20:211
66784991913,3cyclictest0-21swapper/122:25:121
66784991913,3cyclictest0-21swapper/120:00:211
6678499188,7cyclictest152578-21apt23:15:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional