You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 00:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Jul 24, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
453521996054,4cyclictest666676-21latency_hist10:35:003
453509995852,4cyclictest624953-21latency_hist09:55:011
453515995243,6cyclictest335557-21systemd-journal11:40:002
453521994945,3cyclictest765266-21kworker/u8:0+events_unbound12:20:173
453521994945,3cyclictest604122-21kworker/u8:1+events_unbound09:40:013
453508994740,5cyclictest603899-21latency_hist09:35:010
453521994644,2cyclictest604122-21kworker/u8:1+events_unbound09:40:253
453508994436,6cyclictest335557-21systemd-journal11:05:000
453521994340,2cyclictest541338-21kworker/u8:3+events_unbound08:50:293
453515994338,3cyclictest541483-21base6408:35:002
453508994337,4cyclictest640909-21latency_hist10:10:000
453521994239,2cyclictest484534-21kworker/u8:3+events_unbound08:05:233
453521994238,3cyclictest530928-21kworker/u8:0+events_unbound09:00:283
453521994235,5cyclictest335557-21systemd-journal09:15:003
453521994036,3cyclictest620011-21kworker/u8:3+events_unbound10:04:473
453521994036,2cyclictest666705-21kworker/u8:1+events_unbound11:52:283
453521993934,4cyclictest765266-21kworker/u8:0+events_unbound12:39:283
453508993932,5cyclictest630685-21cp10:00:010
453521993835,2cyclictest646082-21kworker/u8:0+events_unbound11:05:213
453521993835,2cyclictest646082-21kworker/u8:0+events_unbound11:05:213
453521993835,2cyclictest646082-21kworker/u8:0+events_unbound10:45:183
453521993832,3cyclictest463759-21kworker/u8:0+events_unbound07:29:293
453521993734,2cyclictest666705-21kworker/u8:1+events_unbound11:45:003
453521993734,2cyclictest541338-21kworker/u8:3+events_unbound09:25:223
453521993734,2cyclictest520619-21kworker/u8:2+events_unbound08:40:153
453521993734,2cyclictest463759-21kworker/u8:0+events_unbound07:31:283
453521993733,3cyclictest666705-21kworker/u8:1+events_unbound10:41:283
453521993733,3cyclictest635964-21kworker/u8:4+events_unbound10:05:233
453521993731,4cyclictest723496-21latency_hist11:30:013
453515993731,3cyclictest530928-21kworker/u8:0+flush-259:009:05:152
453509993732,3cyclictest557570-21/usr/sbin/munin08:50:151
453508993732,4cyclictest515708-21apt-get08:10:120
453521993633,2cyclictest749543-21kworker/u8:4+events_unbound12:00:233
453521993633,2cyclictest656396-21kworker/u8:3+flush-259:010:25:233
453521993632,3cyclictest541338-21kworker/u8:3+events_unbound08:49:293
453521993632,3cyclictest531136-21kworker/u8:4+events_unbound08:30:213
453509993630,4cyclictest567657-21latency_hist09:00:011
453508993629,5cyclictest556414-21ntpq08:45:200
453521993431,2cyclictest530928-21kworker/u8:0+events_unbound09:15:153
453521993430,3cyclictest410425-21kworker/u8:1+events_unbound08:16:283
453521993330,2cyclictest723208-21kworker/u8:2+events_unbound11:45:253
453521993329,3cyclictest484534-21kworker/u8:3+events_unbound08:24:293
453508993328,4cyclictest410425-21kworker/u8:1+flush-259:008:20:000
453521993229,2cyclictest646082-21kworker/u8:0+events_unbound10:35:153
453521993229,2cyclictest410425-21kworker/u8:1+flush-259:007:20:253
453521993229,2cyclictest410425-21kworker/u8:1+events_unbound08:25:233
453521993228,3cyclictest614204-21kworker/u8:2+events_unbound10:10:233
453515993225,6cyclictest635964-21kworker/u8:4+flush-259:010:15:002
453509993228,3cyclictest791513-21apt-get12:35:131
453508993229,2cyclictest526037-21apt-get08:20:120
453508993228,3cyclictest666705-21kworker/u8:1+flush-259:011:55:100
453515993126,3cyclictest708009-21kworker/u8:3+flush-259:011:15:182
453509993127,3cyclictest463759-21kworker/u8:0+flush-259:008:00:001
453508993127,3cyclictest713438-21apt-get11:20:120
453508993126,3cyclictest672123-21apt-get10:40:110
453521993028,2cyclictest598771-21kworker/u8:2+events_unbound09:30:203
453521993027,2cyclictest666705-21kworker/u8:1+events_unbound11:30:153
453521993027,2cyclictest646082-21kworker/u8:0+events_unbound11:10:183
453521993027,2cyclictest530928-21kworker/u8:0+events_unbound08:35:183
453521993027,2cyclictest530928-21kworker/u8:0+events_unbound08:35:183
453515993026,3cyclictest541338-21kworker/u8:3+flush-259:009:20:002
453515993026,3cyclictest463759-21kworker/u8:0+flush-259:007:55:312
453508993026,3cyclictest708009-21kworker/u8:3+events_unbound12:19:280
453508993023,5cyclictest499122-21ntpq07:50:230
453521992926,2cyclictest765266-21kworker/u8:0+events_unbound12:32:293
453521992926,2cyclictest666705-21kworker/u8:1+events_unbound10:56:303
453521992926,2cyclictest614204-21kworker/u8:2+events_unbound09:45:133
453521992926,2cyclictest463759-21kworker/u8:0+events_unbound07:55:273
453521992923,4cyclictest732909-21ntpq11:35:193
453521992923,2cyclictest484534-21kworker/u8:3+events_unbound07:50:203
453509992924,3cyclictest707988-21/usr/sbin/munin11:15:001
453509992924,3cyclictest509-21rs:main1
453508992926,2cyclictest410425-21kworker/u8:1+flush-259:007:15:180
453521992825,2cyclictest410425-21kworker/u8:1+events_unbound07:35:153
453515992822,4cyclictest692521-21latency_hist11:00:002
453508992824,3cyclictest562736-21kworker/u8:1+flush-259:008:59:320
453508992824,3cyclictest410425-21kworker/u8:1+events_unbound07:25:280
453508992822,4cyclictest453462-21latency_hist07:10:010
453521992724,2cyclictest646082-21kworker/u8:0+flush-259:011:00:203
453521992724,2cyclictest209573-21kworker/u8:3+events_unbound07:14:123
453515992721,4cyclictest530928-21kworker/u8:0+flush-259:009:35:162
453509992723,3cyclictest479327-21latency_hist07:35:001
453509992722,4cyclictest604156-21apt-get09:35:111
453509992720,5cyclictest677051-21latency_hist10:45:001
453508992723,3cyclictest671857-21latency_hist10:40:000
453508992723,3cyclictest656396-21kworker/u8:3+events_unbound10:25:280
453508992721,4cyclictest754762-21apt-get12:00:130
453508992721,4cyclictest655434-21ntpq10:20:200
453521992623,2cyclictest666705-21kworker/u8:1+events_unbound11:21:293
453521992623,2cyclictest484534-21kworker/u8:3+flush-259:008:00:213
453515992619,5cyclictest759662-21latency_hist12:05:012
453509992620,4cyclictest525800-21unin-run08:20:001
453508992622,3cyclictest530928-21kworker/u8:0+events_unbound09:09:280
453508992621,4cyclictest541992-21apt-get08:35:110
453508992621,4cyclictest541992-21apt-get08:35:110
453521992521,3cyclictest630333-21gpgv10:00:013
453509992520,3cyclictest484534-21kworker/u8:3+flush-259:008:05:261
453509992519,4cyclictest335557-21systemd-journal11:27:271
453508992522,2cyclictest749543-21kworker/u8:4+events_unbound12:28:290
453508992521,3cyclictest614204-21kworker/u8:2+events_unbound10:12:280
453508992521,3cyclictest410425-21kworker/u8:1+events_unbound08:41:290
453521992421,2cyclictest646082-21kworker/u8:0+events_unbound10:20:203
453509992420,3cyclictest541338-21kworker/u8:3+flush-259:008:45:261
453509992420,3cyclictest484534-21kworker/u8:3+flush-259:008:00:161
453508992421,2cyclictest646082-21kworker/u8:0+flush-259:010:15:200
453508992420,3cyclictest723208-21kworker/u8:2+events_unbound11:43:270
453508992420,3cyclictest530928-21kworker/u8:0+events_unbound09:25:280
453508992419,4cyclictest718619-21apt-get11:25:130
453521992319,3cyclictest520619-21kworker/u8:2+events_unbound08:55:303
453521992319,3cyclictest484534-21kworker/u8:3+events_unbound07:48:283
453521992318,3cyclictest765482-21/usr/sbin/munin12:10:163
453521992318,3cyclictest708233-21/usr/sbin/munin11:15:153
453515992318,4cyclictest775905-21apt-get12:20:132
453515992317,4cyclictest509-21rs:main2
453509992319,3cyclictest708009-21kworker/u8:3+events_unbound12:10:281
453509992319,3cyclictest646082-21kworker/u8:0+events_unbound10:35:211
453509992317,4cyclictest509-21rs:main1
453508992320,2cyclictest749543-21kworker/u8:4+events_unbound12:33:290
453508992320,2cyclictest646082-21kworker/u8:0+events_unbound11:12:290
453508992320,2cyclictest646082-21kworker/u8:0+events_unbound11:05:270
453508992320,2cyclictest646082-21kworker/u8:0+events_unbound11:05:270
453508992319,3cyclictest541338-21kworker/u8:3+flush-259:009:25:010
453508992319,3cyclictest531171-21apt-get08:25:110
453521992219,2cyclictest614204-21kworker/u8:2+events_unbound09:50:243
453515992216,4cyclictest335557-21systemd-journal07:35:002
453509992217,3cyclictest646082-21kworker/u8:0+flush-259:010:20:171
453508992219,2cyclictest614204-21kworker/u8:2+events_unbound10:30:130
453508992219,2cyclictest614204-21kworker/u8:2+events_unbound09:50:220
453508992216,4cyclictest541330-21gpgv08:35:000
453521992117,3cyclictest530928-21kworker/u8:0+events_unbound09:21:133
453521992117,2cyclictest786017-21sh12:30:013
453509992117,3cyclictest765266-21kworker/u8:0+flush-259:012:20:171
453509992116,4cyclictest635964-21kworker/u8:4+events_unbound10:05:211
453509992114,5cyclictest335557-21systemd-journal09:29:271
453508992117,3cyclictest723208-21kworker/u8:2+events_unbound11:38:290
453508992117,3cyclictest666705-21kworker/u8:1+flush-259:011:50:260
453508992117,3cyclictest604122-21kworker/u8:1+flush-259:009:35:240
453515992016,3cyclictest520619-21kworker/u8:2+flush-259:008:40:242
453515992015,4cyclictest410425-21kworker/u8:1+flush-259:007:55:002
453515992014,4cyclictest335557-21systemd-journal12:30:012
453509992017,2cyclictest723208-21kworker/u8:2+events_unbound11:45:221
453509992016,3cyclictest410425-21kworker/u8:1+flush-259:008:10:161
453509992015,3cyclictest531136-21kworker/u8:4+flush-259:008:30:231
453509992015,3cyclictest530928-21kworker/u8:0+flush-259:009:05:251
453508992017,2cyclictest780832-21kworker/u8:2+events_unbound12:35:200
453508992015,4cyclictest630136-21latency_hist10:00:000
453521991916,2cyclictest749543-21kworker/u8:4+events_unbound12:07:293
453515991915,3cyclictest614204-21kworker/u8:2+flush-259:010:20:002
453515991915,2cyclictest410425-21kworker/u8:1+flush-259:008:25:172
453515991914,4cyclictest603905-21munin-plugin-st09:35:002
453515991914,3cyclictest723773-21apt-get11:30:112
453509991912,4cyclictest588418-21latency_hist09:20:011
453508991915,3cyclictest604122-21kworker/u8:1+flush-259:009:40:160
453508991915,3cyclictest541338-21kworker/u8:3+events_unbound09:17:270
453515991812,4cyclictest770387-21latency_hist12:15:022
453515991812,4cyclictest723208-21kworker/u8:2+flush-259:011:45:172
453515991812,4cyclictest624039-21ntpq09:50:212
453515991812,4cyclictest609313-21apt-get09:40:132
453509991814,3cyclictest723208-21kworker/u8:2+flush-259:011:35:211
453509991814,3cyclictest661792-21apt-get10:30:121
453509991814,3cyclictest614204-21kworker/u8:2+events_unbound10:10:201
453508991815,2cyclictest749543-21kworker/u8:4+events_unbound12:05:230
453508991814,3cyclictest562736-21kworker/u8:1+events_unbound09:04:310
45350899180,16cyclictest477026-21kthreadcore07:30:180
453521991714,2cyclictest410425-21kworker/u8:1+events_unbound07:15:283
453515991714,2cyclictest618495-21ntp_kernel_pll_09:45:222
453515991714,2cyclictest516129-21irqcore08:10:182
453515991714,2cyclictest0-21swapper/209:25:002
453515991713,3cyclictest646082-21kworker/u8:0+flush-259:011:05:232
453515991713,3cyclictest646082-21kworker/u8:0+flush-259:011:05:232
453508991714,2cyclictest666705-21kworker/u8:1+events_unbound11:30:250
453508991713,3cyclictest520619-21kworker/u8:2+events_unbound08:54:310
453521991613,2cyclictest749543-21kworker/u8:4+events_unbound11:59:213
453521991613,2cyclictest484534-21kworker/u8:3+events_unbound08:14:243
45351599169,5cyclictest718351-21latency_hist11:25:012
453515991614,1cyclictest707995-21idleruntime-cro11:15:002
453515991612,2cyclictest0-21swapper/207:15:012
453515991611,4cyclictest629324-21sshd09:55:272
453515991610,4cyclictest697662-21latency_hist11:05:002
453509991612,3cyclictest614204-21kworker/u8:2+events_unbound09:45:151
453509991611,3cyclictest335557-21systemd-journal09:57:271
453508991613,2cyclictest60350irq/132-enp0s29f1:rx-010:55:250
453508991613,2cyclictest60350irq/132-enp0s29f1:rx-007:36:510
453508991612,3cyclictest708009-21kworker/u8:3+events_unbound11:15:220
453508991612,3cyclictest410425-21kworker/u8:1+events_unbound07:59:200
453508991612,3cyclictest410425-21kworker/u8:1+events_unbound07:45:160
45352199159,4cyclictest578061-21latency_hist09:10:013
453521991511,3cyclictest646330-21apt-get10:15:113
453515991511,3cyclictest656396-21kworker/u8:3+flush-259:010:25:492
453515991511,3cyclictest410425-21kworker/u8:1+flush-259:007:35:202
453515991511,2cyclictest474123-21sh07:30:012
453509991512,2cyclictest749543-21kworker/u8:4+flush-259:011:55:151
453509991512,2cyclictest463769-21latency_hist07:20:001
453509991511,3cyclictest749543-21kworker/u8:4+events_unbound12:00:271
453509991511,3cyclictest646082-21kworker/u8:0+flush-259:011:20:151
453509991511,3cyclictest410425-21kworker/u8:1+events_unbound07:40:221
453509991510,3cyclictest410425-21kworker/u8:1+flush-259:007:40:011
453508991513,1cyclictest60350irq/132-enp0s29f1:rx-009:10:230
453508991513,1cyclictest60350irq/132-enp0s29f1:rx-008:03:390
453508991512,2cyclictest60350irq/132-enp0s29f1:rx-007:20:180
453508991511,3cyclictest666705-21kworker/u8:1+events_unbound10:50:000
45351599149,3cyclictest677481-21diskstats10:45:132
453515991410,3cyclictest484534-21kworker/u8:3+flush-259:008:00:182
453515991410,3cyclictest410425-21kworker/u8:1+flush-259:007:40:262
453509991411,2cyclictest744582-21fschecks_count11:50:141
453509991411,2cyclictest631244-21irqcore10:00:171
453508991412,2cyclictest60350irq/132-enp0s29f1:rx-008:07:160
453508991412,1cyclictest60350irq/132-enp0s29f1:rx-012:11:390
453508991412,1cyclictest60350irq/132-enp0s29f1:rx-009:45:150
453508991411,2cyclictest60350irq/132-enp0s29f1:rx-012:20:490
453508991411,2cyclictest209573-21kworker/u8:3+events_unbound07:10:180
453508991410,3cyclictest646082-21kworker/u8:0+events_unbound10:50:240
45352199139,3cyclictest410425-21kworker/u8:1+events_unbound07:41:043
453521991310,2cyclictest749543-21kworker/u8:4+events_unbound12:15:243
45351599139,3cyclictest541338-21kworker/u8:3+flush-259:008:45:212
45351599138,4cyclictest651486-21apt-get10:20:122
453515991310,2cyclictest510680-21cpuspeed_turbos08:05:132
45351599130,2cyclictest635744-21awk10:05:012
45350999139,3cyclictest484534-21kworker/u8:3+flush-259:008:20:241
45350999131,10cyclictest614188-21awk09:45:011
453509991310,2cyclictest495187-21cpuspeed_turbos07:50:151
453509991310,2cyclictest0-21swapper/107:45:121
453509991310,2cyclictest0-21swapper/107:15:011
45351599129,2cyclictest557693-21cpuspeed_turbos08:50:132
45351599129,2cyclictest527052-21kthreadcore08:20:182
45351599127,4cyclictest780832-21kworker/u8:2+flush-259:012:35:252
453515991210,1cyclictest468461-21unixbench_multi07:20:272
45350999129,2cyclictest693185-21irqcore11:00:171
45350999129,2cyclictest531393-21fschecks_time08:25:141
45350999128,3cyclictest520619-21kworker/u8:2+flush-259:008:40:181
45350999128,2cyclictest0-21swapper/108:40:001
45350999128,2cyclictest0-21swapper/108:39:591
45350999127,4cyclictest666705-21kworker/u8:1+events_unbound11:40:231
45350999127,4cyclictest567922-21apt-get09:00:111
45350899129,2cyclictest60350irq/132-enp0s29f1:rx-011:45:230
45351599119,1cyclictest0-21swapper/209:15:012
45351599115,4cyclictest765241-21latency_hist12:10:012
45351599110,9cyclictest463777-21awk07:20:012
45350999118,2cyclictest789875-21kthreadcore12:30:181
45350999117,2cyclictest681362-21ntpq10:45:211
45350999114,5cyclictest335557-21systemd-journal10:59:271
45351599107,2cyclictest773020-21kthreadcore12:15:172
45351599107,2cyclictest748309-21needreboot11:50:202
45351599104,4cyclictest335557-21systemd-journal11:45:002
45350999108,1cyclictest698572-21irqcore11:05:151
45350999108,1cyclictest698572-21irqcore11:05:151
45350999104,4cyclictest656396-21kworker/u8:3+flush-259:010:25:181
4535099992,5cyclictest682557-21cut10:50:141
4535159984,3cyclictest401ktimers/210:40:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional