You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 19:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Aug 14, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4120190996056,3cyclictest75-21kswapd010:38:040
4120202995047,2cyclictest75-21kswapd010:38:042
4120206994338,3cyclictest176190-21/usr/sbin/munin11:10:133
4120190994137,3cyclictest4135871-21kworker/u8:1+flush-259:009:15:010
4120196994035,3cyclictest119290-21apt-get10:15:111
4120196994033,5cyclictest4156722-21cp07:45:011
4120202993931,6cyclictest4176799-21ntpq08:00:212
4120206993831,5cyclictest55679-21ntpq09:10:213
4120206993830,6cyclictest196680-21latency_hist11:30:013
4120206993731,4cyclictest4146310-21latency_hist07:35:023
4120206993730,5cyclictest76288-21ntpq09:30:233
4120202993730,5cyclictest335557-21systemd-journal07:50:002
4120190993731,4cyclictest233383-21latency_hist12:05:010
4120190993630,5cyclictest4193369-21base6408:20:010
4120202993531,3cyclictest254107-21kworker/u8:0+flush-259:012:40:002
4120190993528,5cyclictest154445-21ntpq10:45:200
4120196993428,4cyclictest335557-21systemd-journal11:55:001
4120206993329,3cyclictest10038-21kworker/u8:3+flush-259:008:45:223
4120206993329,3cyclictest10038-21kworker/u8:3+flush-259:008:45:213
4120202993329,3cyclictest98316-21kworker/u8:2+flush-259:010:00:012
4120196993329,3cyclictest150417-21kworker/u8:2+flush-259:010:50:201
4120196993328,3cyclictest77302-21gpgv09:35:001
4120206993228,3cyclictest98316-21kworker/u8:2+flush-259:010:05:223
4120206993228,3cyclictest4104609-21kworker/u8:0+events_unbound07:15:263
4120202993229,2cyclictest108742-21kworker/u8:1+flush-259:010:35:002
4120196993228,3cyclictest35883-21kworker/u8:0+flush-259:010:00:271
4120190993127,3cyclictest4104609-21kworker/u8:0+flush-259:007:30:000
4120206993026,3cyclictest207674-21kworker/u8:4+events_unbound12:20:253
4120206993026,3cyclictest206929-21kworker/u8:2+events_unbound11:57:343
4120202993026,3cyclictest4177559-21kworker/u8:3+flush-259:008:05:272
4120202993026,3cyclictest150417-21kworker/u8:2+flush-259:011:05:232
4120196993026,3cyclictest35883-21kworker/u8:0+flush-259:009:00:251
4120190993025,4cyclictest335557-21systemd-journal07:56:330
4120202992925,2cyclictest181165-21kworker/u8:3+flush-259:011:20:152
4120196992924,4cyclictest335557-21systemd-journal09:30:011
4120196992923,4cyclictest335557-21systemd-journal11:10:001
4120206992825,2cyclictest4135871-21kworker/u8:1+flush-259:008:20:153
4120206992822,4cyclictest228409-21/usr/sbin/munin12:00:193
4120206992821,5cyclictest4135871-21kworker/u8:1+flush-259:008:10:173
4120202992824,3cyclictest56762-21kworker/u8:3+flush-259:009:25:002
4120196992825,2cyclictest75-21kswapd010:38:041
4120196992824,3cyclictest4177559-21kworker/u8:3+flush-259:008:05:181
4120196992822,4cyclictest335557-21systemd-journal11:17:331
4120196992822,4cyclictest269544-21latency_hist12:40:001
4120190992823,3cyclictest4157043-21gpgv07:45:010
4120190992822,4cyclictest181149-21latency_hist11:15:010
4120190992821,5cyclictest227272-21ntpq11:55:200
4120206992724,2cyclictest4135871-21kworker/u8:1+events_unbound08:55:153
4120206992723,3cyclictest4135871-21kworker/u8:1+events_unbound08:09:333
4120206992723,3cyclictest4135871-21kworker/u8:1+events_unbound07:57:343
4120206992723,3cyclictest206929-21kworker/u8:2+events_unbound11:45:023
4120206992723,3cyclictest129339-21kworker/u8:3+flush-259:010:30:203
4120206992722,3cyclictest150450-21apt-get10:45:103
4120206992722,3cyclictest10038-21kworker/u8:3+flush-259:008:40:003
4120206992623,2cyclictest56762-21kworker/u8:3+flush-259:009:15:213
4120206992620,4cyclictest77871-21apt-get09:35:113
4120206992619,5cyclictest98719-21diskstats09:55:153
4120202992622,3cyclictest207674-21kworker/u8:4+events_unbound12:35:002
4120202992622,3cyclictest123950-21kworker/u8:0+events_unbound10:25:002
4120202992622,2cyclictest207215-21gpgv11:40:012
4120202992619,5cyclictest98297-21latency_hist09:55:012
4120196992622,3cyclictest129339-21kworker/u8:3+flush-259:010:59:591
4120196992621,3cyclictest145225-21/usr/sbin/munin10:40:131
4120196992620,4cyclictest4104609-21kworker/u8:0+flush-259:008:15:171
4120206992522,2cyclictest56762-21kworker/u8:3+events_unbound09:20:273
4120206992522,2cyclictest181165-21kworker/u8:3+flush-259:011:20:223
4120206992521,3cyclictest4104609-21kworker/u8:0+events_unbound07:20:343
4120202992520,4cyclictest160538-21kworker/u8:1+events_unbound10:55:172
4120202992520,4cyclictest10038-21kworker/u8:3+events_unbound08:35:242
4120202992518,4cyclictest15200-21latency_hist08:35:002
4120196992520,3cyclictest165933-21apt-get11:00:131
4120190992518,5cyclictest201863-21latency_hist11:35:010
4120190992518,4cyclictest129339-21kworker/u8:3+flush-259:010:30:160
4120206992422,1cyclictest4104609-21kworker/u8:0+events_unbound08:04:333
4120206992421,2cyclictest4135871-21kworker/u8:1+flush-259:007:35:203
4120206992421,2cyclictest207674-21kworker/u8:4+flush-259:012:29:343
4120206992420,3cyclictest4135871-21kworker/u8:1+events_unbound09:43:553
4120202992420,3cyclictest206929-21kworker/u8:2+events_unbound12:10:202
4120202992420,2cyclictest72249-21kworker/u8:2+flush-259:009:40:242
4120202992419,4cyclictest82784-21latency_hist09:40:012
4120196992420,3cyclictest35883-21kworker/u8:0+flush-259:009:40:011
4120196992419,3cyclictest114139-21apt-get10:10:121
4120190992418,4cyclictest335557-21systemd-journal08:04:330
4120206992320,2cyclictest4135871-21kworker/u8:1+flush-259:008:25:193
4120206992320,2cyclictest108742-21kworker/u8:1+flush-259:010:40:193
4120190992318,4cyclictest509-21rs:main0
4120206992219,2cyclictest98316-21kworker/u8:2+events_unbound10:25:123
4120206992215,5cyclictest207024-21latency_hist11:40:013
4120202992219,2cyclictest160538-21kworker/u8:1+flush-259:011:10:232
4120202992216,4cyclictest335557-21systemd-journal08:20:342
4120190992218,3cyclictest4177559-21kworker/u8:3+flush-259:008:05:200
4120190992218,3cyclictest35883-21kworker/u8:0+flush-259:009:50:010
4120190992217,3cyclictest181415-21apt-get11:15:110
4120190992216,4cyclictest335557-21systemd-journal10:10:010
4120206992118,2cyclictest4188078-21kworker/u8:2+events_unbound08:53:473
4120206992118,2cyclictest108742-21kworker/u8:1+events_unbound10:15:183
4120206992117,3cyclictest4119806-21kworker/u8:3+flush-259:007:45:163
4120206992117,3cyclictest150417-21kworker/u8:2+events_unbound10:53:583
4120206992117,3cyclictest124402-21/usr/sbin/munin10:20:163
4120206992115,4cyclictest335557-21systemd-journal08:45:003
4120202992117,3cyclictest35883-21kworker/u8:0+events_unbound09:25:182
4120202992116,4cyclictest206929-21kworker/u8:2+flush-259:011:55:002
4120196992117,3cyclictest207674-21kworker/u8:4+events_unbound11:45:001
4120190992116,4cyclictest4104609-21kworker/u8:0+flush-259:007:45:250
4120190992116,4cyclictest160538-21kworker/u8:1+flush-259:010:55:180
4120190992116,3cyclictest103779-21apt-get10:00:110
4120206992017,2cyclictest4135871-21kworker/u8:1+events_unbound09:00:223
4120206992016,3cyclictest129339-21kworker/u8:3+events_unbound10:39:573
4120206992016,2cyclictest4151034-21kworker/u8:2+events_unbound07:54:343
4120206992014,4cyclictest4156807-21cp07:45:013
4120206992014,4cyclictest207674-21kworker/u8:4+flush-259:012:20:003
412019699208,6cyclictest155369-21munin-run10:50:001
4120196992017,2cyclictest229140-21kworker/u8:3+flush-259:012:05:001
4120190992017,2cyclictest4135871-21kworker/u8:1+flush-259:007:50:240
4120190992016,3cyclictest35883-21kworker/u8:0+flush-259:009:45:010
4120190992016,2cyclictest0-21swapper/008:35:000
4120206991915,3cyclictest4135871-21kworker/u8:1+events_unbound09:50:213
4120206991915,3cyclictest4135871-21kworker/u8:1+events_unbound09:45:133
4120206991915,3cyclictest4135871-21kworker/u8:1+events_unbound07:25:133
4120206991915,3cyclictest150417-21kworker/u8:2+events_unbound11:15:183
4120202991916,2cyclictest35883-21kworker/u8:0+flush-259:009:00:212
4120202991915,3cyclictest4104609-21kworker/u8:0+flush-259:007:30:222
4120202991914,4cyclictest207674-21kworker/u8:4+events_unbound12:25:012
4120202991914,3cyclictest35883-21kworker/u8:0+flush-259:010:00:152
4120202991914,3cyclictest150417-21kworker/u8:2+flush-259:010:50:242
4120196991916,2cyclictest254053-21idleruntime-cro12:25:001
4120196991915,2cyclictest20641-21apt-get08:40:111
4120190991915,2cyclictest4104609-21kworker/u8:0+events_unbound08:15:000
4120190991914,4cyclictest206929-21kworker/u8:2+flush-259:012:15:260
4120206991814,3cyclictest4135871-21kworker/u8:1+flush-259:008:30:133
4120206991814,3cyclictest150417-21kworker/u8:2+events_unbound11:00:193
4120202991815,2cyclictest206929-21kworker/u8:2+events_unbound12:15:232
4120202991814,3cyclictest4135871-21kworker/u8:1+events_unbound08:10:162
4120202991814,3cyclictest206929-21kworker/u8:2+events_unbound11:55:232
4120202991811,5cyclictest335557-21systemd-journal09:50:012
4120196991813,4cyclictest83022-21/usr/sbin/munin09:40:141
4120190991813,4cyclictest4193903-21apt-get08:20:120
4120206991714,2cyclictest206929-21kworker/u8:2+flush-259:012:06:503
4120206991713,3cyclictest207674-21kworker/u8:4+flush-259:011:50:023
4120206991713,3cyclictest191138-21kworker/u8:0+events_unbound11:40:013
4120206991710,5cyclictest50461-21ntpq09:05:203
4120202991713,3cyclictest150417-21kworker/u8:2+flush-259:011:15:232
4120202991711,4cyclictest9083-21ntpq08:25:202
4120190991713,1cyclictest60350irq/132-enp0s29f1:rx-009:05:150
4120190991712,3cyclictest206929-21kworker/u8:2+flush-259:011:40:160
4120190991711,4cyclictest5126-21apt-get08:25:100
4120190991711,4cyclictest249340-21diskstats12:20:140
412020699169,5cyclictest335557-21systemd-journal12:15:003
4120206991614,1cyclictest0-21swapper/308:19:593
4120206991612,3cyclictest207674-21kworker/u8:4+flush-259:012:35:173
4120202991613,2cyclictest4135871-21kworker/u8:1+events_unbound07:55:012
4120202991613,2cyclictest238568-21idleruntime-cro12:10:012
4120202991612,3cyclictest4135871-21kworker/u8:1+events_unbound07:25:252
4120202991611,4cyclictest98316-21kworker/u8:2+events_unbound10:05:192
4120196991613,2cyclictest99579-21kthreadcore09:55:191
4120196991612,2cyclictest26815-21kthreadcore08:45:171
4120196991612,2cyclictest26815-21kthreadcore08:45:171
4120196991612,2cyclictest0-21swapper/107:55:011
4120196991611,3cyclictest56794-21apt-get09:15:101
4120196991610,4cyclictest4130774-21latency_hist07:20:001
4120190991613,2cyclictest60350irq/132-enp0s29f1:rx-011:50:280
4120190991613,2cyclictest60350irq/132-enp0s29f1:rx-011:25:150
4120190991613,2cyclictest60350irq/132-enp0s29f1:rx-008:56:130
4120190991613,2cyclictest60350irq/132-enp0s29f1:rx-008:35:290
4120190991613,2cyclictest60350irq/132-enp0s29f1:rx-007:30:140
412020699159,4cyclictest4124726-21ntpq07:10:213
4120206991512,2cyclictest129339-21kworker/u8:3+events_unbound10:55:353
4120206991511,3cyclictest160538-21kworker/u8:1+events_unbound11:30:213
4120202991512,2cyclictest4135871-21kworker/u8:1+flush-259:008:55:212
4120202991511,3cyclictest108742-21kworker/u8:1+flush-259:010:40:272
4120202991511,2cyclictest207674-21kworker/u8:4+flush-259:011:45:162
4120202991510,4cyclictest207674-21kworker/u8:4+flush-259:012:20:172
4120196991511,3cyclictest4135871-21kworker/u8:1+flush-259:008:31:381
4120196991511,3cyclictest4082248-21kworker/u8:2+flush-259:007:10:251
4120196991511,3cyclictest206929-21kworker/u8:2+flush-259:011:56:071
4120190991513,2cyclictest60350irq/132-enp0s29f1:rx-008:50:320
4120190991513,2cyclictest60350irq/132-enp0s29f1:rx-007:18:440
4120190991513,1cyclictest61150irq/133-enp0s29f1:tx-008:40:250
4120190991513,1cyclictest60350irq/132-enp0s29f1:rx-011:45:270
4120190991512,2cyclictest60350irq/132-enp0s29f1:rx-012:37:280
4120190991512,2cyclictest60350irq/132-enp0s29f1:rx-012:25:120
4120190991511,3cyclictest264353-21cron12:34:590
4120190991511,2cyclictest60350irq/132-enp0s29f1:rx-009:50:130
4120190991510,4cyclictest4135871-21kworker/u8:1+flush-259:007:35:250
4120206991411,2cyclictest206929-21kworker/u8:2+flush-259:012:30:063
4120206991410,3cyclictest98316-21kworker/u8:2+events_unbound10:12:243
4120196991410,2cyclictest4135871-21kworker/u8:1+events_unbound08:20:191
412019699140,3cyclictest191514-21idleruntime-cro11:25:001
412019099149,4cyclictest129339-21kworker/u8:3+flush-259:010:40:150
4120190991412,1cyclictest60350irq/132-enp0s29f1:rx-011:00:160
4120190991412,1cyclictest60350irq/132-enp0s29f1:rx-010:50:090
4120190991412,1cyclictest60350irq/132-enp0s29f1:rx-010:25:170
4120190991412,1cyclictest60350irq/132-enp0s29f1:rx-010:20:260
4120190991412,1cyclictest60350irq/132-enp0s29f1:rx-009:25:280
4120190991411,2cyclictest60350irq/132-enp0s29f1:rx-011:35:170
4120190991411,2cyclictest60350irq/132-enp0s29f1:rx-009:30:110
4120190991410,3cyclictest98316-21kworker/u8:2+flush-259:010:10:210
412020699139,3cyclictest150417-21kworker/u8:2+events_unbound11:05:583
412020299139,3cyclictest4151034-21kworker/u8:2+events_unbound07:55:232
412020299138,4cyclictest4082248-21kworker/u8:2+events_unbound07:10:162
4120202991310,2cyclictest191945-21fschecks_count11:25:132
4120202991310,2cyclictest160538-21kworker/u8:1+flush-259:011:30:212
4120196991311,1cyclictest10038-21kworker/u8:3+flush-259:008:40:011
4120196991310,2cyclictest4119806-21kworker/u8:3+flush-259:007:21:031
412019099139,3cyclictest507-21in:imuxsock09:20:000
4120190991311,2cyclictest61150irq/133-enp0s29f1:tx-009:20:200
4120190991311,2cyclictest60350irq/132-enp0s29f1:rx-009:36:130
4120190991310,2cyclictest60350irq/132-enp0s29f1:rx-011:25:000
4120190991310,2cyclictest60350irq/132-enp0s29f1:rx-008:45:120
4120190991310,2cyclictest60350irq/132-enp0s29f1:rx-008:45:110
4120190991310,2cyclictest60350irq/132-enp0s29f1:rx-007:10:220
412020299129,3cyclictest4104609-21kworker/u8:0+events_unbound08:15:222
412020299129,2cyclictest4148843-21kthreadcore07:35:182
412020299129,2cyclictest0-21swapper/208:50:002
412020299129,2cyclictest0-21swapper/208:50:002
412020299128,3cyclictest4188078-21kworker/u8:2+flush-259:008:40:212
412020299128,2cyclictest0-21swapper/210:45:192
412020299128,2cyclictest0-21swapper/210:25:212
412020299120,4cyclictest233389-21munin-run12:05:002
412019699129,2cyclictest509-21rs:main1
412019699129,2cyclictest4135871-21kworker/u8:1+flush-259:007:25:291
412019699129,2cyclictest202388-21fschecks_time11:35:141
412019699129,1cyclictest0-21swapper/108:55:271
412019699128,3cyclictest191771-21apt-get11:25:111
412019099129,2cyclictest4120151-21apt-key07:10:010
4120190991210,1cyclictest60350irq/132-enp0s29f1:rx-012:12:340
4120190991210,1cyclictest60350irq/132-enp0s29f1:rx-012:05:160
412020699117,3cyclictest98316-21kworker/u8:2+events_unbound10:02:223
412020699117,2cyclictest56762-21kworker/u8:3+events_unbound09:27:053
412020299117,3cyclictest4135871-21kworker/u8:1+flush-259:007:40:162
412020299117,3cyclictest4132055-21kthreadcore07:20:172
412020299117,3cyclictest4104609-21kworker/u8:0+events_unbound07:15:122
412019699118,2cyclictest93824-21sed09:50:161
412019699118,2cyclictest4158327-21tr07:45:171
412019699118,2cyclictest139209-21unixbench_multi10:30:241
412019699116,4cyclictest4167894-21perl07:55:151
412019699108,1cyclictest197359-21grep11:30:161
412019699107,2cyclictest213141-21fschecks_time11:45:141
412019699106,2cyclictest4150529-21ntpq07:35:221
41201969996,2cyclictest56762-21kworker/u8:3+flush-259:009:20:181
41201969994,4cyclictest4183379-21cut08:10:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional