You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 21:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 31, 2026 12:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
355515721960,3sleep3575-21kworker/3:2+events12:38:033
3226122995445,6cyclictest3516176-21latency_hist12:00:010
33034572530,2chrt0-21swapper/108:27:581
3226130995145,4cyclictest3277706-21kworker/u8:3+events_unbound08:38:071
3226130995041,7cyclictest3401970-21latency_hist10:05:011
3226130994943,5cyclictest3397244-21kworker/u8:2+flush-8:010:38:111
3226122994943,4cyclictest3173708-21kworker/u8:0+flush-8:007:20:000
3226130994842,4cyclictest3243109-21kworker/u8:2+flush-8:007:38:121
3226130994839,7cyclictest275-21systemd-journal12:20:001
3226122994840,6cyclictest3332294-21apt-get08:55:010
3226122994740,5cyclictest3452132-21kworker/u8:1+flush-8:011:18:110
3226130994641,3cyclictest3258049-21kworker/u8:1+events_unbound08:08:131
3226130994540,3cyclictest3288022-21kworker/u8:0+events_unbound09:12:581
3226130994538,5cyclictest3258049-21kworker/u8:1+flush-8:008:33:081
3226130994537,6cyclictest3496831-21/usr/sbin/munin11:43:091
3226130994439,4cyclictest3352498-21kworker/u8:2+flush-8:009:43:131
3226130994437,5cyclictest3258049-21kworker/u8:1+flush-8:009:03:071
3226130994339,3cyclictest3496416-21kworker/u8:0+events_unbound11:57:571
3226130994338,4cyclictest3387121-21kworker/u8:0+events_unbound09:57:561
322139924328,9sleep10-21swapper/107:06:181
3226134994237,3cyclictest3352498-21kworker/u8:2+flush-8:009:40:012
3226130994237,4cyclictest3496416-21kworker/u8:0+events_unbound12:22:561
3226130994230,8cyclictest275-21systemd-journal11:12:541
3226122994234,6cyclictest3357196-21latency_hist09:20:010
33184522410,2sleep3471rcuc/308:43:003
3226130994136,4cyclictest3421959-21kworker/u8:3+flush-8:010:57:571
3226130994135,4cyclictest3462012-21kworker/u8:2+events_unbound11:32:561
3226130994134,5cyclictest3496416-21kworker/u8:0+flush-8:012:28:081
3226130994131,7cyclictest275-21systemd-journal09:47:541
3226130994030,6cyclictest275-21systemd-journal07:22:551
35240402390,2sleep3471rcuc/312:08:023
3226130993931,6cyclictest3174573-21kworker/u8:3+events_unbound07:28:071
3226130993928,7cyclictest275-21systemd-journal11:55:001
3226122993934,4cyclictest3496416-21kworker/u8:0+flush-8:012:02:560
3226122993928,9cyclictest275-21systemd-journal12:30:000
32449992380,2sleep3481ktimers/307:28:013
3226130993834,3cyclictest3462012-21kworker/u8:2+events_unbound11:08:011
3226130993832,4cyclictest3421959-21kworker/u8:3+events_unbound11:02:591
3226130993831,5cyclictest3387121-21kworker/u8:0+flush-8:009:53:071
3226130993831,5cyclictest3258049-21kworker/u8:1+flush-8:008:58:071
3226130993830,5cyclictest3451444-21grep10:53:121
3226130993733,3cyclictest3288022-21kworker/u8:0+events_unbound08:52:561
3226130993724,9cyclictest275-21systemd-journal11:22:551
3226122993729,6cyclictest275-21systemd-journal08:45:010
3226130993630,4cyclictest3496416-21kworker/u8:0+flush-8:012:33:071
3226130993629,5cyclictest3452132-21kworker/u8:1+flush-8:011:18:121
3226130993629,5cyclictest3397244-21kworker/u8:2+events_unbound10:18:041
3226130993529,5cyclictest3258049-21kworker/u8:1+events_unbound07:53:071
3226130993529,4cyclictest3496416-21kworker/u8:0+events_unbound11:48:111
3226122993531,3cyclictest3496416-21kworker/u8:0+flush-8:012:18:070
3226134993427,5cyclictest275-21systemd-journal07:15:002
3226130993429,4cyclictest3258049-21kworker/u8:1+events_unbound09:33:021
3226130993429,3cyclictest3421959-21kworker/u8:3+events_unbound10:48:001
3226122993423,9cyclictest3272696-21apt-get07:55:000
3226122993329,3cyclictest3497078-21tr11:42:540
32215002334,10sleep20-21swapper/207:07:352
3226134993226,4cyclictest3492594-21irqrtprio11:37:592
3226130993228,2cyclictest0-21swapper/109:30:001
3226130993227,3cyclictest3429307-21kthreadcore10:33:021
3226130993227,3cyclictest3429307-21kthreadcore10:33:021
3226130993227,3cyclictest3362159-21latency_hist09:25:001
3226130993226,4cyclictest3551504-21apt-get12:37:511
3226130993226,4cyclictest3452132-21kworker/u8:1+flush-8:011:28:121
3226130993224,6cyclictest3407375-21apt-get10:12:521
3226130993223,7cyclictest3526759-21/usr/sbin/munin12:13:041
3226122993226,4cyclictest3253495-21diskstats07:37:570
3226122993224,6cyclictest3417217-21/usr/sbin/munin10:23:050
3226122993222,8cyclictest3490717-21ntpq11:33:060
3226134993122,7cyclictest3366848-21unixbench_multi09:28:142
3226130993127,3cyclictest3387121-21kworker/u8:0+events_unbound10:27:551
3226130993125,4cyclictest3277706-21kworker/u8:3-ext4-rsv-conversion08:05:011
3226130993125,4cyclictest3258049-21kworker/u8:1+flush-8:008:48:021
3226130993124,5cyclictest3273369-21/usr/sbin/munin07:58:111
3226122993126,3cyclictest3252755-21idleruntime-cro07:34:590
3226122993125,4cyclictest3502151-21fschecks_time11:48:020
3226130993026,2cyclictest3258049-21kworker/u8:1+events_unbound10:23:011
3226130993025,4cyclictest3173708-21kworker/u8:0+events_unbound07:18:061
3226122993025,4cyclictest3397244-21kworker/u8:2+flush-8:010:03:010
3226122993024,4cyclictest3492597-21irqrtprio11:37:580
3226122993020,8cyclictest3388298-21irqrtprio09:53:000
3226134992921,6cyclictest3467475-21fschecks_count11:12:572
3226134992917,9cyclictest3436579-21awk10:39:592
3226130992925,3cyclictest3277706-21kworker/u8:3+events_unbound09:08:131
3226130992924,3cyclictest3496416-21kworker/u8:0+flush-8:012:03:051
3226130992923,4cyclictest3258049-21kworker/u8:1+events_unbound07:47:551
3226130992922,4cyclictest3421959-21kworker/u8:3+events_unbound10:43:081
3226122992923,4cyclictest3377015-21unixbench_singl09:38:140
3226122992922,5cyclictest3317483-21sendmail08:40:000
3226122992917,10cyclictest0-21swapper/008:30:000
32579612280,3sleep3575-21kworker/3:2-events07:40:023
3226134992824,3cyclictest3461542-21unixbench_multi11:03:132
3226134992820,7cyclictest3411645-21unixbench_singl10:13:132
3226130992823,3cyclictest3298413-21cpuspeed_turbos08:22:551
3226130992823,3cyclictest3258884-21irqcore07:43:001
3226122992821,5cyclictest3297438-21grep08:18:130
3226122992819,6cyclictest3372257-21latency_hist09:35:000
3226134992724,2cyclictest3506046-21unixbench_multi11:48:172
3226134992722,3cyclictest3351989-21grep09:13:132
3226134992721,4cyclictest3173708-21kworker/u8:0+flush-8:007:25:002
3226130992722,4cyclictest3231023-21systemd-run07:15:001
322613099272,17cyclictest571-21snmpd11:37:521
3226122992723,3cyclictest3367315-21apt-key09:30:000
3226122992723,3cyclictest3352498-21kworker/u8:2+flush-8:009:48:090
3226122992721,4cyclictest3555786-21unixbench_singl12:38:110
3226134992622,2cyclictest3243404-21aten2_r5power_p07:27:552
3226130992622,3cyclictest3258049-21kworker/u8:1+events_unbound10:08:141
3226130992620,4cyclictest3277706-21kworker/u8:3+flush-8:009:18:051
3226130992620,4cyclictest3174573-21kworker/u8:3+flush-8:007:32:591
3226122992622,2cyclictest0-21swapper/011:23:000
3226122992621,4cyclictest3277706-21kworker/u8:3+flush-8:009:07:580
3226122992621,4cyclictest3258049-21kworker/u8:1+flush-8:009:21:260
3226122992621,4cyclictest3243109-21kworker/u8:2+flush-8:008:07:570
3226122992621,3cyclictest3441508-21cron10:45:000
3226122992621,1cyclictest0-21swapper/009:43:110
3226134992519,4cyclictest3263563-21fschecks_count07:47:582
3226134992518,6cyclictest3546792-21fschecks_count12:32:562
3226130992521,3cyclictest3372994-21cut09:37:581
3226130992521,2cyclictest3525837-21unixbench_multi12:08:121
3226122992521,2cyclictest0-21swapper/010:55:000
3226122992520,4cyclictest3441976-21kworker/u8:0+flush-8:010:58:070
3226122992520,4cyclictest3387121-21kworker/u8:0+flush-8:010:07:570
3226122992520,3cyclictest3411826-21cron10:15:000
3226122992514,9cyclictest3526083-21apt-get12:10:000
3226122992514,8cyclictest3507000-21diskstats11:52:550
3226134992421,2cyclictest3515985-21grep11:58:122
3226134992421,2cyclictest3441312-21unixbench_singl10:43:142
3226134992421,2cyclictest3386899-21unixbench_singl09:48:112
3226134992421,2cyclictest3288618-21fschecks_time08:12:592
3226134992420,3cyclictest3531217-21cron12:15:002
3226134992420,3cyclictest3396997-21idleruntime-cro10:00:002
3226134992420,2cyclictest3328156-21fschecks_time08:52:582
3226130992421,2cyclictest3277706-21kworker/u8:3+events_unbound08:13:071
3226130992419,3cyclictest0-21swapper/108:45:011
3226122992419,4cyclictest3387121-21kworker/u8:0+flush-8:010:33:120
3226122992419,4cyclictest3387121-21kworker/u8:0+flush-8:010:33:120
3226122992419,3cyclictest3312353-21unixbench_singl08:33:130
3226122992416,6cyclictest3471674-21latency_hist11:15:010
3226122992414,8cyclictest0-21swapper/009:00:000
3226134992319,3cyclictest3412339-21aten2_r5power_c10:17:542
3226134992319,2cyclictest0-21swapper/208:00:002
3226134992318,4cyclictest3317473-21sendmail08:40:002
3226130992317,4cyclictest3297504-21unixbench_singl08:18:141
322612299237,5cyclictest0-21swapper/012:21:140
3226122992319,2cyclictest849-21mta-sts-daemon08:22:250
3226122992318,4cyclictest3396805-21unixbench_singl09:58:120
3226122992318,4cyclictest3348031-21cpuspeed_turbos09:12:560
3226122992318,4cyclictest3273987-21sort07:58:030
3226122992318,3cyclictest3422791-21sort10:28:000
3226122992317,4cyclictest3243109-21kworker/u8:2+events_unbound08:03:020
3226122992316,5cyclictest3462012-21kworker/u8:2+flush-8:011:08:110
3226134992217,3cyclictest0-21swapper/209:25:002
3226122992218,3cyclictest851-21mta-sts-daemon10:48:010
3226122992217,3cyclictest0-21swapper/010:20:000
3226122992212,8cyclictest3242106-21ntpq07:23:050
32259152222,3sleep00-21swapper/007:09:420
3226134992118,2cyclictest3506861-21aten2_r5power_v11:52:552
3226134992116,4cyclictest0-21swapper/210:50:002
3226134992112,7cyclictest3522288-21sed12:08:002
3226134992110,9cyclictest3555984-21awk12:40:012
3226122992117,2cyclictest0-21swapper/012:12:530
3226122992114,5cyclictest3247597-21grep07:28:120
3226122992113,6cyclictest3550457-21ps12:33:100
3226122992112,7cyclictest3461047-21ntpq11:03:060
322613499207,5cyclictest0-21swapper/209:02:542
322613499202,13cyclictest3278325-21apt-get08:02:542
3226134992017,2cyclictest3536765-21aten2_r5power_v12:22:552
3226134992017,2cyclictest3472178-21aten2_r5power_c11:17:552
3226134992017,2cyclictest3387887-21fschecks_time09:52:572
3226134992016,3cyclictest0-21swapper/207:55:002
3226134992016,2cyclictest0-21swapper/211:08:012
3226134992015,3cyclictest3251980-21grep07:33:052
3226134992012,6cyclictest3431618-21cron10:35:002
3226134992012,6cyclictest3431618-21cron10:35:002
3226134992011,7cyclictest3447260-21cut10:52:542
3226134992011,7cyclictest3353544-21sed09:17:592
3226134992010,7cyclictest3426855-21grep10:30:002
322613499200,10cyclictest34876431cut11:32:592
3226122992016,3cyclictest3323131-21sh08:47:560
3226122992016,3cyclictest3258049-21kworker/u8:1+flush-8:009:02:570
3226122992016,2cyclictest3292747-21idleruntime-cro08:15:000
3226122992015,4cyclictest3174573-21kworker/u8:3+flush-8:007:13:130
3226122992012,6cyclictest3485806-21ntpq11:28:060
3226122992012,6cyclictest3397244-21kworker/u8:2+events_unbound10:38:050
322613499192,13cyclictest3346588-21ntpq09:08:062
3226134991916,2cyclictest0-21swapper/208:58:042
3226134991914,4cyclictest3462012-21kworker/u8:2+flush-8:011:42:562
3226134991914,3cyclictest3258405-21aten2_r5power_v07:42:552
3226134991914,3cyclictest0-21swapper/208:20:002
3226134991911,6cyclictest3397507-21cut10:02:552
3226134991911,6cyclictest3382319-21sed09:45:012
3226134991910,7cyclictest3320249-21cut08:43:032
3226134991910,7cyclictest3254268-21tr07:38:022
3226134991910,7cyclictest3236951-21tr07:18:052
3226122991910,7cyclictest3258957-21cut07:43:000
32214662195,8sleep30-21swapper/307:07:083
322613499189,7cyclictest3533265-21tr12:18:002
3226134991814,3cyclictest3367877-21aten2_r5power_p09:32:552
3226134991813,3cyclictest3323113-21cpuspeed_turbos08:47:552
3226134991813,3cyclictest0-21swapper/208:35:002
3226134991812,5cyclictest0-21swapper/208:20:182
3226122991814,2cyclictest0-21swapper/007:47:560
322613499179,6cyclictest3543611-21tr12:27:592
322613499179,6cyclictest3517256-21cut12:02:582
322613499179,6cyclictest3477628-21sed11:23:002
322613499179,6cyclictest3455217-21tr10:58:022
322613499172,6cyclictest0-21swapper/211:28:592
3226134991713,3cyclictest3417460-21tr10:22:552
3226134991710,5cyclictest3405593-21tr10:08:042
3226134991613,2cyclictest0-21swapper/208:27:412
3226134991613,2cyclictest0-21swapper/208:05:112
32783002152,8sleep30-21swapper/308:02:533
34770502145,5sleep30-21swapper/311:22:533
34479082140,2sleep3481ktimers/310:53:003
34126852145,6sleep30-21swapper/310:17:583
33863662145,5sleep30-21swapper/309:48:053
35312132132,6sleep30-21swapper/312:15:013
35062732132,6sleep30-21swapper/311:50:013
33712542135,5sleep30-21swapper/309:33:043
33473502132,6sleep30-21swapper/309:10:013
32773922133,7sleep30-21swapper/307:58:163
32677452132,6sleep30-21swapper/307:50:023
35461612122,6sleep30-21swapper/312:30:013
35166762122,6sleep30-21swapper/312:02:533
35122332122,6sleep30-21swapper/311:58:003
34973832122,7sleep30-21swapper/311:42:593
34956762123,6sleep30-21swapper/311:38:063
34910362122,6sleep30-21swapper/311:33:123
34843932122,6sleep30-21swapper/311:28:033
34760912122,6sleep30-21swapper/311:18:123
34667642122,5sleep30-21swapper/311:10:013
34627252120,8sleep30-21swapper/311:08:023
34573452122,6sleep30-21swapper/311:02:553
34527152122,6sleep30-21swapper/310:57:583
34446222122,6sleep30-21swapper/310:48:033
34325732122,6sleep30-21swapper/310:38:013
34271402122,6sleep30-21swapper/310:32:543
34271402122,6sleep30-21swapper/310:32:543
34075372122,6sleep30-21swapper/310:12:563
33963182122,6sleep30-21swapper/309:58:083
33879552122,6sleep30-21swapper/309:52:583
33732252122,6sleep30-21swapper/309:38:023
33626262123,5sleep30-21swapper/309:27:553
33580402122,6sleep30-21swapper/309:22:573
33567792122,6sleep30-21swapper/309:18:123
33317172122,6sleep30-21swapper/308:53:133
33267312122,6sleep30-21swapper/308:48:113
33079422122,6sleep30-21swapper/308:31:543
33036252122,6sleep30-21swapper/308:28:013
32973372122,6sleep30-21swapper/308:18:143
32924942122,6sleep30-21swapper/308:13:163
32829272122,6sleep30-21swapper/308:05:033
32582942122,6sleep30-21swapper/307:42:553
32337872122,6sleep30-21swapper/307:17:593
35455852112,6sleep30-21swapper/312:28:093
35365502112,5sleep30-21swapper/312:21:553
35266682112,6sleep30-21swapper/312:11:443
35015702113,5sleep30-21swapper/311:45:203
34375082112,6sleep30-21swapper/310:43:013
34220232112,6sleep30-21swapper/310:25:563
34169972112,5sleep30-21swapper/310:20:023
34021132112,5sleep30-21swapper/310:05:023
33972462112,6sleep30-21swapper/310:00:083
33780812112,5sleep30-21swapper/309:42:593
33427462112,5sleep30-21swapper/309:06:483
33376782112,5sleep30-21swapper/309:00:023
33329272112,6sleep30-21swapper/308:57:213
33133802112,6sleep30-21swapper/308:38:013
32979322112,5sleep30-21swapper/308:20:033
32631332112,6sleep30-21swapper/307:46:283
32522952112,6sleep30-21swapper/307:33:123
32381802112,6sleep30-21swapper/307:20:323
32259912111,5sleep30-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional