You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 22:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed May 06, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3325255994336,4cyclictest3620807-21latency_hist11:55:003
3325246994240,1cyclictest3439118-21kworker/0:1+pm09:11:210
3325250993531,3cyclictest3438980-21gpgv09:00:001
3325250993431,2cyclictest3610670-21kworker/u8:3+flush-259:011:50:001
3325250993329,3cyclictest3428795-21kworker/u8:1+flush-259:010:05:011
3325255993224,6cyclictest3365432-21ntpq07:45:213
3325253993228,3cyclictest3542493-21kworker/u8:4+flush-259:011:30:152
3325253993226,5cyclictest3325177-21latency_hist07:10:012
3325250993227,4cyclictest3325465-21apt-get07:10:121
3325253993125,4cyclictest252-21systemd-journal09:06:452
3325246992823,4cyclictest3330606-21apt-get07:15:140
3325253992720,6cyclictest3443530-21ntpq09:00:202
3325246992721,4cyclictest3532137-21latency_hist10:30:010
3325246992721,4cyclictest252-21systemd-journal08:00:450
3325250992619,5cyclictest3645732-21ntpq12:15:221
3325250992522,2cyclictest3553051-21kworker/u8:2+flush-259:011:20:001
3325255992420,3cyclictest3584484-40mandb11:17:213
3325253992419,3cyclictest252-21systemd-journal07:10:452
3325250992419,4cyclictest3600427-21apt-get11:35:131
3325246992417,5cyclictest252-21systemd-journal12:10:450
3325255992318,3cyclictest3444711-21apt-get09:05:123
3325250992319,3cyclictest1268794-21kworker/u8:2+flush-259:007:30:001
3325250992317,3cyclictest3340642-21kworker/u8:3+flush-259:008:00:171
3325246992317,4cyclictest252-21systemd-journal11:20:450
3325246992315,7cyclictest3615627-21turbostat11:50:000
3325250992217,3cyclictest3428828-21apt-get08:50:121
3325250992217,3cyclictest3171319-21kworker/u8:0+flush-259:007:25:001
3325246992217,4cyclictest3417912-21kworker/u8:2+flush-259:009:45:520
3325246992216,4cyclictest252-21systemd-journal10:24:450
3325246992214,6cyclictest3583791-21ntpq11:15:200
3325255992117,3cyclictest3574343-21cat11:10:023
3325255992116,3cyclictest252-21systemd-journal09:57:443
3325253992117,3cyclictest3397530-21apt-get08:20:112
3325253992117,2cyclictest3381825-21kworker/u8:0+flush-259:009:00:012
3325250992117,2cyclictest3361193-21sh07:45:011
3325250992117,2cyclictest3361193-21sh07:45:001
3325250992116,3cyclictest3511541-21kworker/u8:0+flush-259:010:15:011
3325246992117,3cyclictest252-21systemd-journal12:39:150
3325255992014,4cyclictest3407987-21diskstats08:30:133
3325253992014,4cyclictest252-21systemd-journal10:27:452
3325250992015,3cyclictest3553051-21kworker/u8:2+flush-259:011:20:211
3325246992016,3cyclictest3568443-21gpgv11:05:010
3325246992013,5cyclictest3547645-21latency_hist10:45:010
3325253991914,4cyclictest3485633-21latency_hist09:45:002
3325253991914,4cyclictest3381825-21kworker/u8:0+flush-259:008:50:172
3325250991912,5cyclictest3475351-21latency_hist09:35:011
3325246991915,3cyclictest3417912-21kworker/u8:2+flush-259:009:40:240
3325246991913,4cyclictest3417011-21ntpq08:35:220
3325255991811,5cyclictest252-21systemd-journal07:20:003
3325253991815,2cyclictest509-21rs:main2
3325253991815,2cyclictest507-21in:imuxsock08:30:012
3325253991815,2cyclictest132-1kworker/2:1H+kblockd09:11:212
3325253991815,2cyclictest0-21swapper/209:29:592
3325250991815,2cyclictest3387647-21irqcore08:10:141
3325250991815,2cyclictest3367624-21kthreadcore07:50:161
3325250991814,3cyclictest3590094-21kworker/u8:0+flush-259:011:25:201
3325250991814,3cyclictest3532398-21apt-get10:30:111
3325250991814,3cyclictest3475616-21apt-get09:35:111
3325250991814,3cyclictest3417912-21kworker/u8:2+flush-259:009:05:211
3325250991813,3cyclictest3590094-21kworker/u8:0+flush-259:011:40:201
3325246991815,2cyclictest3438890-21gpgv09:00:000
3325246991815,2cyclictest3417912-21kworker/u8:2+flush-259:009:54:590
3325246991815,2cyclictest3381825-21kworker/u8:0+flush-259:008:25:200
3325246991813,4cyclictest3557999-21kworker/u8:3+flush-259:011:05:160
3325246991811,5cyclictest3427285-21ntpq08:45:210
3325255991712,4cyclictest3417865-21latency_hist08:40:013
3325255991712,3cyclictest252-21systemd-journal08:20:453
332525599170,16cyclictest1-21systemd10:15:003
3325253991712,3cyclictest3356296-21apt-get07:40:112
3325253991712,3cyclictest3356296-21apt-get07:40:112
3325253991711,4cyclictest3635351-21ntpq12:05:202
3325253991710,5cyclictest3656080-21ntpq12:25:202
3325253991710,5cyclictest3656080-21ntpq12:25:192
3325253991710,5cyclictest3573906-21latency_hist11:10:012
3325250991713,2cyclictest0-21swapper/110:50:001
3325250991712,3cyclictest0-21swapper/108:50:001
3325246991714,2cyclictest3642116-21irqcore12:15:170
3325246991713,3cyclictest60350irq/132-enp0s29f1:rx-012:25:190
3325246991713,3cyclictest60350irq/132-enp0s29f1:rx-012:25:190
3325246991712,4cyclictest3631337-21kworker/u8:2+flush-259:012:07:200
3325246991712,3cyclictest3341043-21diskstats07:25:130
332524699171,15cyclictest587621-21sshd09:20:450
3325246991710,5cyclictest3355104-21ntpq07:35:190
3325255991613,2cyclictest3607852-21tr11:40:183
3325255991613,2cyclictest3454388-21fwupd09:11:213
3325255991613,2cyclictest3379216-21kthreadcore08:00:183
3325255991612,3cyclictest500-21systemd-logind08:10:003
3325255991610,4cyclictest3490769-21latency_hist09:50:013
3325253991613,2cyclictest3412698-21sh08:35:002
3325253991611,4cyclictest3568514-21cat11:05:002
3325250991612,3cyclictest3511541-21kworker/u8:0+flush-259:010:30:011
3325250991612,3cyclictest3381825-21kworker/u8:0+flush-259:008:20:161
3325250991611,4cyclictest3590094-21kworker/u8:0+events_unbound11:50:181
3325246991614,1cyclictest60350irq/132-enp0s29f1:rx-008:50:140
3325246991613,2cyclictest60350irq/132-enp0s29f1:rx-009:35:110
3325246991613,2cyclictest60350irq/132-enp0s29f1:rx-009:00:240
3325246991613,2cyclictest60350irq/132-enp0s29f1:rx-008:09:090
3325246991612,3cyclictest3417912-21kworker/u8:2+flush-259:009:05:150
3325246991610,4cyclictest252-21systemd-journal10:15:000
332525599159,5cyclictest3552820-21latency_hist10:50:013
332525599159,4cyclictest3662342-21/usr/sbin/munin12:35:143
332525599150,14cyclictest1-21systemd10:05:013
3325253991512,2cyclictest3611125-21irqcore11:45:172
3325253991511,3cyclictest3511541-21kworker/u8:0+flush-259:010:50:012
3325253991510,4cyclictest1268794-21kworker/u8:2+flush-259:008:20:002
3325253991510,3cyclictest3573913-21apt-get11:10:042
3325250991511,3cyclictest3631337-21kworker/u8:2+flush-259:012:10:571
3325250991511,3cyclictest3454701-21cron09:14:591
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-011:55:220
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-011:40:250
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-011:25:090
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-010:46:180
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-010:00:170
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-009:32:020
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-009:25:200
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:240
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-007:46:280
3325246991513,1cyclictest60350irq/132-enp0s29f1:rx-007:30:140
3325246991512,2cyclictest60350irq/132-enp0s29f1:rx-011:35:140
3325246991512,2cyclictest60350irq/132-enp0s29f1:rx-011:30:120
3325246991512,2cyclictest60350irq/132-enp0s29f1:rx-008:40:110
332525599148,4cyclictest252-21systemd-journal09:00:013
3325255991411,2cyclictest3647268-21irqcore12:20:163
3325253991412,1cyclictest3620811-21munin-run11:55:002
3325253991411,2cyclictest3623366-21kthreadcore11:55:172
332525099149,3cyclictest3568991-21/usr/sbin/munin11:05:191
332525099148,4cyclictest3511541-21kworker/u8:0+flush-259:010:20:241
332525099147,5cyclictest3636272-21latency_hist12:10:011
3325250991411,2cyclictest3657177-21kworker/u8:0+flush-259:012:35:001
3325250991411,2cyclictest3657177-21kworker/u8:0+flush-259:012:35:001
332524699148,5cyclictest3396383-21ntpq08:15:210
3325246991412,1cyclictest60350irq/132-enp0s29f1:rx-012:24:220
3325246991412,1cyclictest60350irq/132-enp0s29f1:rx-010:51:560
3325246991412,1cyclictest60350irq/132-enp0s29f1:rx-008:30:220
3325246991411,2cyclictest60350irq/132-enp0s29f1:rx-012:00:240
3325246991411,2cyclictest60350irq/132-enp0s29f1:rx-010:55:590
3325246991411,2cyclictest60350irq/132-enp0s29f1:rx-007:10:130
332525599138,4cyclictest3626233-21apt-get12:00:113
3325255991310,2cyclictest3351261-21cpuspeed_turbos07:35:133
332525399137,4cyclictest252-21systemd-journal09:20:462
332525399132,6cyclictest3340627-21awk07:25:012
3325253991311,1cyclictest0-21swapper/207:20:002
3325253991310,2cyclictest3661293-21cut12:30:212
3325253991310,2cyclictest3661293-21cut12:30:212
3325253991310,2cyclictest3590094-21kworker/u8:0+flush-259:011:40:272
3325253991310,1cyclictest0-21swapper/208:40:212
332525399130,7cyclictest3381803-21awk08:05:002
332525099139,3cyclictest3340642-21kworker/u8:3+flush-259:008:35:181
332525099139,2cyclictest3383083-21grep08:05:151
332525099139,2cyclictest0-21swapper/110:20:011
332525099139,2cyclictest0-21swapper/107:55:251
332525099137,4cyclictest252-21systemd-journal09:20:001
332525099136,5cyclictest1-21systemd11:05:001
332524699138,4cyclictest60350irq/132-enp0s29f1:rx-011:10:120
332524699132,8cyclictest0-21swapper/010:20:000
3325246991312,1cyclictest60350irq/132-enp0s29f1:rx-012:34:250
3325246991312,1cyclictest60350irq/132-enp0s29f1:rx-012:34:240
3325246991312,1cyclictest60350irq/132-enp0s29f1:rx-008:20:230
3325246991311,1cyclictest60350irq/132-enp0s29f1:rx-008:10:580
3325246991311,1cyclictest60350irq/132-enp0s29f1:rx-007:50:160
3325246991311,1cyclictest60350irq/132-enp0s29f1:rx-007:22:210
332525599129,2cyclictest3556964-21needreboot10:50:183
332525599129,2cyclictest3481759-21kthreadcore09:40:153
332525599129,2cyclictest3396253-21needreboot08:15:193
332525599128,2cyclictest252-21systemd-journal12:14:553
332525599128,2cyclictest1-21systemd11:05:013
332525599127,3cyclictest3329516-21ntpq07:10:223
332525599125,5cyclictest3350014-21ntpq07:30:213
3325255991210,1cyclictest3537673-21cpuspeed_turbos10:35:123
3325255991210,1cyclictest3428480-21latency_hist08:50:013
332525399129,2cyclictest3589867-21munin-plugin-st11:25:012
332525399127,4cyclictest252-21systemd-journal08:15:012
332525399126,4cyclictest252-21systemd-journal12:05:002
332525399121,3cyclictest3417865-21latency_hist08:40:012
3325253991210,1cyclictest0-21swapper/207:55:002
332525099129,2cyclictest3621136-21cpuspeed_turbos11:55:111
332525099129,2cyclictest3465452-21cpuspeed_turbos09:25:121
332525099128,3cyclictest3666342-21ntp_kernel_pll_12:35:211
332525099128,3cyclictest3417912-21kworker/u8:2+flush-259:009:40:141
332525099127,3cyclictest252-21systemd-journal07:48:161
332525099126,4cyclictest3350637-21kworker/u8:1+events_unbound07:35:121
332525099126,3cyclictest3620418-21kworker/u8:4+events_unbound12:05:001
3325250991210,1cyclictest311ktimers/110:37:281
3325250991210,1cyclictest0-21swapper/110:05:201
3325250991210,1cyclictest0-21swapper/109:45:251
332525099120,4cyclictest34633401kthreadcore09:20:171
332525099120,4cyclictest3407567-21awk08:30:001
332524699129,2cyclictest60350irq/132-enp0s29f1:rx-011:50:200
332524699129,2cyclictest60350irq/132-enp0s29f1:rx-010:07:300
332524699129,2cyclictest60350irq/132-enp0s29f1:rx-007:55:140
332524699129,2cyclictest60350irq/132-enp0s29f1:rx-007:40:120
332524699129,2cyclictest60350irq/132-enp0s29f1:rx-007:40:110
3325246991210,1cyclictest60350irq/132-enp0s29f1:rx-009:59:450
332525399119,1cyclictest0-21swapper/210:50:142
332525399119,1cyclictest0-21swapper/207:25:162
332525399117,3cyclictest3417912-21kworker/u8:2+flush-259:009:15:212
332525399111,2cyclictest3527014-21awk10:24:592
332525099119,1cyclictest0-21swapper/111:30:201
332525099119,1cyclictest0-21swapper/108:40:121
332525099118,2cyclictest3542493-21kworker/u8:4+flush-259:011:10:371
332525099118,2cyclictest3331625-21tr07:15:181
332525099118,1cyclictest0-21swapper/112:25:151
332525099118,1cyclictest0-21swapper/112:25:151
332525099117,3cyclictest3340642-21kworker/u8:3+flush-259:008:30:111
332525099115,4cyclictest252-21systemd-journal11:00:011
332525599108,1cyclictest0-21swapper/307:50:203
332525599106,3cyclictest3588982-21awk11:20:203
332525599106,3cyclictest3417912-21kworker/u8:2+flush-259:010:28:153
332525599105,4cyclictest3614810-21ntp_states11:45:213
332525399108,1cyclictest0-21swapper/210:15:192
332525399107,2cyclictest0-21swapper/210:40:262
332525399106,3cyclictest3491287-21fschecks_time09:50:122
332525099107,2cyclictest3346265-21fschecks_time07:30:141
332525099105,4cyclictest3646398-21kworker/u8:4+flush-259:012:20:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional