You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 12:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jan 11, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
85306994135,4cyclictest153268-21latency_hist20:15:013
85303994037,2cyclictest215588-21kworker/u8:2+flush-259:021:15:222
85303993632,3cyclictest183996-21kworker/u8:3+flush-259:020:50:212
85306993327,4cyclictest298248-21ntpq22:30:203
85303993229,2cyclictest64830-21kworker/u8:4+flush-259:019:45:222
85300993226,4cyclictest303474-21ntpq22:35:281
85303993128,2cyclictest315155-21kworker/u8:2+flush-259:023:10:132
85303993127,3cyclictest341175-21kworker/u8:3+flush-259:023:30:192
85303993127,3cyclictest220928-21kworker/u8:0+flush-259:022:35:292
85303993126,3cyclictest220928-21kworker/u8:0+events_unbound22:00:212
85295993023,5cyclictest95645-21latency_hist19:20:010
85303992926,2cyclictest361608-21kworker/u8:0+flush-259:023:45:212
85303992925,3cyclictest367002-21kworker/u8:4+flush-259:000:05:192
85303992925,3cyclictest204788-21kworker/u8:2+flush-259:021:05:212
85303992925,3cyclictest189533-21kworker/u8:4+flush-259:021:00:222
85300992925,3cyclictest418796-21kworker/u8:0+events_unbound00:35:141
85300992924,4cyclictest382628-21kworker/u8:0+events_unbound23:55:131
85303992825,2cyclictest64830-21kworker/u8:4+events_unbound20:10:212
85303992824,3cyclictest158361-21kworker/u8:3+flush-259:020:25:152
85300992824,3cyclictest361822-21/usr/sbin/munin23:35:131
85303992723,3cyclictest361608-21kworker/u8:0+events_unbound23:35:212
85300992723,3cyclictest341175-21kworker/u8:3+flush-259:023:20:161
85300992621,3cyclictest220928-21kworker/u8:0+flush-259:022:25:221
85300992620,4cyclictest116387-21cp19:40:001
85300992619,5cyclictest252-21systemd-journal00:20:011
85306992521,3cyclictest355808-21kworker/u8:1+flush-259:000:00:183
85303992522,2cyclictest326004-21kworker/u8:0+events_unbound23:25:112
85303992521,3cyclictest189529-21kworker/u8:1+events_unbound21:20:162
85303992521,3cyclictest173613-21kworker/u8:0+events_unbound20:35:182
85303992520,4cyclictest64830-21kworker/u8:4+events_unbound19:15:132
85303992519,4cyclictest299177-21latency_hist22:35:012
85306992419,4cyclictest147170-21ntpq20:05:203
85303992421,2cyclictest64830-21kworker/u8:4+flush-259:019:40:222
85306992319,3cyclictest397450-21kworker/u8:3+flush-259:000:30:003
85306992319,3cyclictest204788-21kworker/u8:2+flush-259:021:05:223
85303992320,2cyclictest64830-21kworker/u8:4+flush-259:019:30:152
85303992320,2cyclictest377434-21kworker/u8:2+events_unbound23:50:242
85303992319,3cyclictest241035-21kworker/u8:3+flush-259:021:45:212
85300992319,3cyclictest121556-21kworker/u8:0+flush-259:019:45:141
85306992218,3cyclictest356687-21apt-get23:30:113
85306992216,4cyclictest252-21systemd-journal20:00:013
85303992218,3cyclictest267770-21kworker/u8:1+events_unbound22:07:222
85303992218,3cyclictest121583-21kworker/u8:3+events_unbound20:02:212
85300992218,3cyclictest507-21in:imuxsock20:10:011
85300992218,3cyclictest361608-21kworker/u8:0+flush-259:023:40:161
85300992217,4cyclictest382628-21kworker/u8:0+flush-259:023:55:011
85295992217,3cyclictest236395-21apt-get21:35:000
85295992216,4cyclictest509-21rs:main0
85303992118,3cyclictest80019-21kworker/u8:0+flush-259:019:10:222
85303992118,2cyclictest147860-21kworker/u8:2+events_unbound20:40:212
85303992117,3cyclictest147860-21kworker/u8:2+events_unbound20:20:212
85300992116,3cyclictest509-21rs:main1
85300992116,3cyclictest252-21systemd-journal21:26:221
85300992114,5cyclictest509-21rs:main1
85306992017,2cyclictest2971-21cron22:30:013
85303992017,2cyclictest241035-21kworker/u8:3+flush-259:022:15:222
85303992017,1cyclictest0-21swapper/200:25:012
85303992015,3cyclictest252-21systemd-journal20:58:212
85300992017,2cyclictest413698-21systemd-run00:25:011
85300992016,3cyclictest397450-21kworker/u8:3+events_unbound00:10:201
85300992016,3cyclictest299199-21kworker/u8:4+events_unbound22:40:141
85295992017,2cyclictest138047-21apt-get20:00:120
85306991917,1cyclictest0-21swapper/323:19:593
85306991915,3cyclictest367002-21kworker/u8:4+flush-259:023:45:003
85306991912,5cyclictest252-21systemd-journal23:15:003
85303991916,2cyclictest326004-21kworker/u8:0+flush-259:023:15:242
85303991916,2cyclictest220928-21kworker/u8:0+events_unbound22:45:102
85303991916,2cyclictest153104-21kworker/u8:0+flush-259:020:17:152
85303991915,3cyclictest367002-21kworker/u8:4+flush-259:000:15:192
85303991915,3cyclictest215588-21kworker/u8:2+events_unbound21:35:132
85303991913,4cyclictest429082-21latency_hist00:40:012
85300991916,2cyclictest335644-21kworker/u8:1+flush-259:023:10:261
85300991916,2cyclictest236659-21latency_hist21:35:011
85300991915,3cyclictest408235-21kworker/u8:1+flush-259:000:30:211
85300991915,3cyclictest267770-21kworker/u8:1+events_unbound22:20:191
85300991914,3cyclictest393010-21latency_hist00:05:011
85300991914,3cyclictest153191-21kworker/u8:1+flush-259:020:20:141
85300991914,3cyclictest153104-21kworker/u8:0+events_unbound20:15:191
85300991912,5cyclictest257449-21latency_hist21:55:001
85306991815,2cyclictest263271-21irqcore22:00:173
85306991815,2cyclictest226071-21idleruntime-cro21:25:013
85306991815,2cyclictest210414-21kworker/u8:3+flush-259:021:10:203
85306991814,3cyclictest326004-21kworker/u8:0+flush-259:023:05:233
85303991816,1cyclictest341175-21kworker/u8:3+flush-259:023:20:232
85303991815,2cyclictest367002-21kworker/u8:4+flush-259:023:57:492
85303991815,2cyclictest309323-21kworker/u8:3+events_unbound22:50:182
85303991814,3cyclictest299199-21kworker/u8:4+events_unbound22:40:192
85303991814,3cyclictest2213501-21kworker/u8:1+events_unbound19:37:192
85303991814,3cyclictest189529-21kworker/u8:1+events_unbound21:13:212
85303991814,2cyclictest252-21systemd-journal23:04:592
85300991814,3cyclictest220928-21kworker/u8:0+events_unbound22:20:001
85300991814,3cyclictest189533-21kworker/u8:4+flush-259:021:00:261
85300991812,5cyclictest324569-21ntpq22:55:201
85295991813,3cyclictest60350irq/132-enp0s29f1:rx-023:55:210
85306991714,2cyclictest404037-21irqcore00:15:163
85306991714,2cyclictest367002-21kworker/u8:4+events_unbound00:00:013
85306991713,3cyclictest189529-21kworker/u8:1+flush-259:021:00:153
85306991712,4cyclictest262587-21latency_hist22:00:003
85306991711,4cyclictest194683-21awk20:55:003
85303991714,2cyclictest267770-21kworker/u8:1+events_unbound22:20:202
85303991714,2cyclictest220928-21kworker/u8:0+events_unbound21:50:122
85303991713,3cyclictest95880-21kworker/u8:0+flush-259:019:20:102
85303991713,3cyclictest397450-21kworker/u8:3+flush-259:000:25:222
85303991713,3cyclictest387865-21kworker/u8:2+events_unbound00:00:152
85303991713,3cyclictest315155-21kworker/u8:2+flush-259:022:55:232
85300991714,2cyclictest220928-21kworker/u8:0+flush-259:022:30:211
85300991713,3cyclictest309323-21kworker/u8:3+events_unbound22:45:121
85300991713,3cyclictest153191-21kworker/u8:1+events_unbound20:25:221
85300991712,4cyclictest95907-21apt-get19:20:101
85295991712,4cyclictest169045-21/usr/sbin/munin20:30:150
85295991712,3cyclictest309525-21apt-get22:44:590
85306991612,3cyclictest309323-21kworker/u8:3+flush-259:023:04:593
85306991612,3cyclictest257103-21kworker/u8:1+flush-259:021:55:003
85306991612,3cyclictest2213501-21kworker/u8:1+flush-259:019:20:193
85303991613,2cyclictest293612-21gpgv22:30:012
85303991613,2cyclictest147860-21kworker/u8:2+events_unbound20:45:192
85303991612,3cyclictest408235-21kworker/u8:1+events_unbound00:30:212
85303991612,3cyclictest309323-21kworker/u8:3+flush-259:023:07:432
85300991612,3cyclictest361608-21kworker/u8:0+flush-259:023:45:211
85300991612,3cyclictest257103-21kworker/u8:1+events_unbound21:55:221
85295991614,1cyclictest60350irq/132-enp0s29f1:rx-023:13:130
85295991614,1cyclictest60350irq/132-enp0s29f1:rx-021:55:260
85295991614,1cyclictest60350irq/132-enp0s29f1:rx-021:15:290
85295991614,1cyclictest60350irq/132-enp0s29f1:rx-000:30:190
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-023:20:250
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-023:05:200
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-022:45:190
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-022:22:250
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-021:10:520
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-019:50:200
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-019:34:480
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-000:25:220
85295991613,2cyclictest60350irq/132-enp0s29f1:rx-000:15:580
85295991613,2cyclictest372763-21cpuspeed_turbos23:45:130
85295991612,3cyclictest60350irq/132-enp0s29f1:rx-000:20:110
85295991610,4cyclictest205654-21/usr/sbin/munin21:05:140
85306991512,2cyclictest393692-21irqcore00:05:173
85306991511,3cyclictest309323-21kworker/u8:3+flush-259:023:00:003
85306991511,3cyclictest184606-21apt-get20:45:113
85306991511,2cyclictest0-21swapper/323:40:013
85306991511,2cyclictest0-21swapper/300:10:193
85303991512,2cyclictest257103-21kworker/u8:1+events_unbound21:57:232
85303991511,3cyclictest367002-21kworker/u8:4+flush-259:000:14:222
85300991512,2cyclictest367002-21kworker/u8:4+flush-259:000:05:201
85300991511,3cyclictest80019-21kworker/u8:0+flush-259:019:10:211
85300991511,3cyclictest64830-21kworker/u8:4+flush-259:019:25:151
85300991511,3cyclictest189533-21kworker/u8:4+events_unbound20:55:121
85300991510,4cyclictest173613-21kworker/u8:0+flush-259:020:41:251
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-022:50:470
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-022:10:120
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-022:05:130
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-022:03:420
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:150
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-020:16:590
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-020:09:330
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:260
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-000:10:160
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-000:06:550
85295991513,1cyclictest60350irq/132-enp0s29f1:rx-000:00:240
85295991512,2cyclictest61150irq/133-enp0s29f1:tx-022:30:220
85295991512,2cyclictest61150irq/133-enp0s29f1:tx-021:02:220
85295991512,2cyclictest61150irq/133-enp0s29f1:tx-020:50:150
85295991512,2cyclictest61150irq/133-enp0s29f1:tx-019:10:190
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-023:53:510
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-023:41:410
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-023:37:530
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-023:16:460
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-022:15:140
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-021:45:190
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-020:46:450
85295991512,2cyclictest60350irq/132-enp0s29f1:rx-019:45:150
8530699148,4cyclictest356429-21latency_hist23:30:013
8530699148,4cyclictest252-21systemd-journal20:19:193
85306991411,2cyclictest159107-21irqcore20:20:173
85306991410,3cyclictest509-21rs:main3
85306991410,3cyclictest153191-21kworker/u8:1+flush-259:020:30:253
85303991412,1cyclictest0-21swapper/223:44:592
85303991411,2cyclictest275505-21kthreadcore22:10:192
85303991411,2cyclictest2213501-21kworker/u8:1+events_unbound19:25:212
85303991411,2cyclictest215588-21kworker/u8:2+events_unbound21:30:202
85303991411,2cyclictest153191-21kworker/u8:1+events_unbound20:34:552
8530099147,5cyclictest241935-21latency_hist21:40:001
85300991410,3cyclictest95880-21kworker/u8:0+events_unbound19:30:021
85300991410,3cyclictest241035-21kworker/u8:3+flush-259:021:40:181
85300991410,3cyclictest183996-21kworker/u8:3+events_unbound20:45:221
8529599148,4cyclictest111544-21diskstats19:35:130
85295991412,1cyclictest61150irq/133-enp0s29f1:tx-021:20:230
85295991412,1cyclictest60350irq/132-enp0s29f1:rx-022:55:240
85295991412,1cyclictest60350irq/132-enp0s29f1:rx-021:40:150
85295991412,1cyclictest60350irq/132-enp0s29f1:rx-021:25:150
85295991412,1cyclictest60350irq/132-enp0s29f1:rx-020:55:240
85295991412,1cyclictest60350irq/132-enp0s29f1:rx-020:37:350
85295991412,1cyclictest60350irq/132-enp0s29f1:rx-019:27:190
85295991411,2cyclictest60350irq/132-enp0s29f1:rx-022:25:200
85295991411,2cyclictest355969-21unixbench_multi23:25:240
8530699139,3cyclictest252-21systemd-journal19:26:193
8530699137,5cyclictest490-21dbus-daemon19:20:003
8530699137,4cyclictest111125-21latency_hist19:35:013
85306991310,2cyclictest376684-21ntp_offset23:45:213
85306991310,2cyclictest309037-21unixbench_multi22:40:273
85306991310,2cyclictest267770-21kworker/u8:1+flush-259:022:35:213
85306991310,2cyclictest138457-21irqcore20:00:173
8530399139,3cyclictest189529-21kworker/u8:1+flush-259:021:26:002
8530099139,3cyclictest173613-21kworker/u8:0+events_unbound20:35:151
8530099139,3cyclictest126782-21kworker/u8:1+flush-259:019:55:161
8530099139,3cyclictest115929-21kworker/u8:2+flush-259:019:40:151
8530099138,3cyclictest509-21rs:main1
85300991310,2cyclictest64830-21kworker/u8:4+events_unbound19:15:191
85300991310,2cyclictest326004-21kworker/u8:0+flush-259:023:25:151
85300991310,2cyclictest315155-21kworker/u8:2+flush-259:023:00:211
85300991310,2cyclictest210414-21kworker/u8:3+flush-259:021:15:001
8529599139,3cyclictest133058-21fschecks_count19:55:150
8529599138,1cyclictest60350irq/132-enp0s29f1:rx-000:35:140
8529599137,4cyclictest325881-21diskstats23:00:130
85295991312,1cyclictest60350irq/132-enp0s29f1:rx-020:27:020
85295991311,1cyclictest60350irq/132-enp0s29f1:rx-021:50:240
85295991310,2cyclictest60350irq/132-enp0s29f1:rx-022:35:130
85295991310,2cyclictest60350irq/132-enp0s29f1:rx-020:21:080
85295991310,2cyclictest60350irq/132-enp0s29f1:rx-020:14:360
85295991310,2cyclictest60350irq/132-enp0s29f1:rx-019:20:220
8530699129,2cyclictest117167-21fschecks_count19:40:153
8530699128,3cyclictest273193-21/usr/sbin/munin22:10:143
8530699127,3cyclictest241922-21cron21:40:003
8530699126,4cyclictest252-21systemd-journal21:45:003
8530699126,4cyclictest132620-21latency_hist19:55:013
8530699121,3cyclictest351262-21latency_hist23:25:013
85306991210,1cyclictest179166-21cron20:40:003
85306991210,1cyclictest0-21swapper/319:40:013
8530399127,4cyclictest133046-21diskstats19:55:142
8530099128,3cyclictest330886-21apt-get23:05:131
8530099128,3cyclictest267770-21kworker/u8:1+flush-259:022:10:131
8530699119,1cyclictest272942-21cron22:10:003
8530699117,3cyclictest367002-21kworker/u8:4+flush-259:023:50:213
8530399117,3cyclictest64830-21kworker/u8:4+flush-259:019:50:102
8530399117,3cyclictest64830-21kworker/u8:4+events_unbound20:05:062
8530399117,2cyclictest215588-21kworker/u8:2+flush-259:021:40:052
8530099117,2cyclictest220928-21kworker/u8:0+flush-259:022:05:211
8530099117,2cyclictest0-21swapper/120:10:271
8529599118,2cyclictest60350irq/132-enp0s29f1:rx-023:33:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional