You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 09:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Jan 02, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
492682993831,5cyclictest673087-21ntpq22:00:221
492682993630,4cyclictest679143-21latency_hist22:10:001
492678993633,2cyclictest699935-21kworker/u8:2+flush-259:022:30:230
492682993430,3cyclictest735955-21kworker/u8:2+flush-259:023:25:191
492678993428,4cyclictest497794-21latency_hist19:15:010
492678993330,2cyclictest761770-21kworker/u8:1+events_unbound23:40:170
492688993226,4cyclictest767239-21kworker/u8:2+flush-259:023:50:003
492688993226,4cyclictest548609-21ntpq20:00:233
492688993126,3cyclictest736235-21latency_hist23:05:013
492678993125,4cyclictest612074-21/usr/sbin/munin21:05:150
492686993023,5cyclictest252-21systemd-journal23:10:012
492678993027,2cyclictest795121-21kworker/u8:2+flush-259:000:15:250
492688992925,3cyclictest617117-21gpgv21:10:013
492682992925,3cyclictest648552-21/usr/sbin/munin21:40:151
492682992925,3cyclictest632818-21kworker/u8:3+flush-259:021:50:201
492682992924,4cyclictest761770-21kworker/u8:1+flush-259:000:25:001
492678992925,3cyclictest668646-21kworker/u8:1+flush-259:022:10:260
492678992924,4cyclictest570164-21latency_hist20:25:010
492678992825,2cyclictest720852-21kworker/u8:3+flush-259:023:05:210
492678992821,5cyclictest252-21systemd-journal22:45:000
492678992724,2cyclictest528844-21kworker/u8:0+flush-259:019:50:270
492678992722,3cyclictest544306-21latency_hist20:00:010
492678992623,2cyclictest803814-21kworker/u8:0+flush-259:000:30:000
492678992622,3cyclictest518760-21apt-get19:35:120
492688992520,3cyclictest700476-21apt-get22:30:133
492688992519,4cyclictest829953-21latency_hist00:35:013
492686992519,4cyclictest565206-21/usr/sbin/munin20:20:152
492682992522,2cyclictest575054-21kworker/u8:0+flush-259:020:35:271
492682992420,3cyclictest508145-21kworker/u8:4+flush-259:019:55:171
492678992420,3cyclictest638097-21kworker/u8:2+flush-259:021:40:220
492688992319,3cyclictest523863-21/usr/sbin/munin19:40:133
492688992318,4cyclictest507898-21kworker/u8:2+flush-259:020:15:263
492688992318,3cyclictest252-21systemd-journal19:46:403
492688992316,4cyclictest793826-21cat00:00:013
49268899231,20cyclictest1-21systemd23:10:003
492686992319,3cyclictest668646-21kworker/u8:1+flush-259:023:05:002
492678992319,3cyclictest705190-21kworker/u8:0+flush-259:022:55:180
492686992217,4cyclictest252-21systemd-journal23:30:012
492682992219,2cyclictest554888-21kworker/u8:3+flush-259:020:30:001
492682992218,3cyclictest638097-21kworker/u8:2+flush-259:021:35:231
492678992218,3cyclictest632818-21kworker/u8:3+flush-259:022:30:010
492688992117,3cyclictest539090-21kworker/u8:1+flush-259:020:10:253
492688992115,4cyclictest762292-21/usr/sbin/munin23:30:253
492688992115,4cyclictest721076-21apt-get22:50:133
492688992114,4cyclictest596427-21latency_hist20:50:003
492686992115,4cyclictest648312-21latency_hist21:40:012
492682992118,2cyclictest674045-21kworker/u8:0+flush-259:022:15:151
492682992118,2cyclictest668646-21kworker/u8:1+flush-259:022:45:171
492682992118,2cyclictest668646-21kworker/u8:1+flush-259:022:25:181
492682992118,2cyclictest575054-21kworker/u8:0+flush-259:021:10:231
492682992117,2cyclictest761770-21kworker/u8:1+flush-259:000:00:211
492682992116,4cyclictest559917-21cat20:15:001
492682992116,4cyclictest507230-21ntpq19:20:201
492682992116,3cyclictest793446-21latency_hist23:59:591
492678992118,2cyclictest668646-21kworker/u8:1+events_unbound22:50:200
492678992115,5cyclictest803264-21ntpq00:05:230
492678992115,4cyclictest782700-21apt-get23:50:010
492688992013,4cyclictest700220-21latency_hist22:30:003
492682992017,2cyclictest507898-21kworker/u8:2+flush-259:019:25:201
492682992015,3cyclictest596662-21/usr/sbin/munin20:50:141
492682992015,3cyclictest544570-21apt-get20:00:111
492678992017,2cyclictest492665-21kworker/u8:1+flush-259:019:30:240
492678992014,4cyclictest575321-21apt-get20:30:010
492688991915,3cyclictest638097-21kworker/u8:2+flush-259:021:40:173
492688991913,4cyclictest575321-21apt-get20:30:013
492686991915,3cyclictest809551-21apt-get00:15:112
492686991915,3cyclictest606402-21kworker/u8:1+flush-259:021:00:292
492682991917,1cyclictest829952-21cron00:35:001
492682991916,2cyclictest720852-21kworker/u8:3+flush-259:023:05:191
492682991916,2cyclictest632818-21kworker/u8:3+flush-259:022:10:181
492682991914,3cyclictest767454-21/usr/sbin/munin23:35:251
492678991916,2cyclictest668646-21kworker/u8:1+flush-259:022:00:210
492678991915,3cyclictest684726-21diskstats22:15:140
492688991815,2cyclictest663686-21cron21:55:003
492688991813,4cyclictest606402-21kworker/u8:1+flush-259:021:20:253
492688991813,4cyclictest252-21systemd-journal23:55:003
492682991815,2cyclictest795121-21kworker/u8:2+flush-259:000:05:271
492682991815,2cyclictest692052-21kthreadcore22:20:181
492682991813,4cyclictest750832-21ntpq23:15:221
492682991812,4cyclictest709615-21ntpq22:35:241
492678991815,2cyclictest0-21swapper/023:40:010
492678991814,3cyclictest741631-21kworker/u8:0+flush-259:023:10:160
492678991814,3cyclictest502709-21kworker/u8:3+flush-259:019:40:180
492688991714,2cyclictest804140-21idleruntime-cro00:10:003
492688991711,4cyclictest252-21systemd-journal19:39:403
492688991711,4cyclictest252-21systemd-journal19:15:003
492686991712,3cyclictest591510-21/usr/sbin/munin20:45:142
492682991714,2cyclictest795121-21kworker/u8:2+flush-259:000:15:231
492682991714,2cyclictest767239-21kworker/u8:2+events_unbound23:50:171
492682991714,2cyclictest668646-21kworker/u8:1+events_unbound22:50:241
492682991714,2cyclictest638097-21kworker/u8:2+flush-259:021:45:261
492682991712,3cyclictest252-21systemd-journal21:55:401
492682991711,4cyclictest502055-21ntpq19:15:211
492678991714,2cyclictest735955-21kworker/u8:2+flush-259:023:15:200
492678991714,2cyclictest606402-21kworker/u8:1+events_unbound21:20:010
492678991714,2cyclictest575054-21kworker/u8:0+flush-259:021:10:250
492678991713,3cyclictest509-21rs:main0
492678991713,2cyclictest0-21swapper/023:25:010
492678991711,5cyclictest610960-21ntpq21:00:260
492688991612,3cyclictest834145-21ntp_kernel_pll_00:35:243
492688991612,3cyclictest834145-21ntp_kernel_pll_00:35:233
492688991612,2cyclictest0-21swapper/322:24:593
492688991611,4cyclictest539090-21kworker/u8:1+flush-259:020:10:003
492688991611,4cyclictest539090-21kworker/u8:1+flush-259:020:10:003
492688991610,4cyclictest611838-21latency_hist21:05:003
49268699164,5cyclictest689470-21cron22:20:002
492682991613,2cyclictest761770-21kworker/u8:1+events_unbound00:35:201
492682991613,2cyclictest761770-21kworker/u8:1+events_unbound00:35:191
492678991614,1cyclictest60350irq/132-enp0s29f1:rx-023:55:180
492678991614,1cyclictest60350irq/132-enp0s29f1:rx-000:20:260
492678991613,2cyclictest679135-21sh22:09:590
492678991613,2cyclictest60350irq/132-enp0s29f1:rx-021:20:150
492678991612,3cyclictest632818-21kworker/u8:3+events_unbound21:25:240
492678991612,3cyclictest60350irq/132-enp0s29f1:rx-023:00:120
49268899159,4cyclictest638080-21latency_hist21:30:013
49268899159,4cyclictest252-21systemd-journal21:59:543
492688991513,1cyclictest0-21swapper/319:19:593
492688991511,3cyclictest781744-21kworker/u8:3+flush-259:000:00:003
492688991511,3cyclictest580696-21kworker/u8:1+flush-259:020:35:293
49268699158,1cyclictest622593-21munin-run21:15:002
49268699157,1cyclictest191rcu_preempt22:05:192
49268699155,2cyclictest41-21ksoftirqd/223:25:002
49268699153,2cyclictest667925-21ntpq21:55:222
49268699153,10cyclictest673995-21awk22:05:002
49268699152,2cyclictest543433-21ld19:55:222
492686991513,1cyclictest0-21swapper/221:10:022
492686991512,2cyclictest0-21swapper/219:15:002
492686991510,4cyclictest679404-21apt-get22:10:122
49268699150,8cyclictest819599-21munin-run00:25:002
49268699150,10cyclictest518506-21awk19:35:002
492682991513,1cyclictest0-21swapper/100:14:591
492678991513,1cyclictest60350irq/132-enp0s29f1:rx-021:45:160
492678991513,1cyclictest60350irq/132-enp0s29f1:rx-020:50:100
492678991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:200
492678991513,1cyclictest60350irq/132-enp0s29f1:rx-020:13:430
492678991513,1cyclictest60350irq/132-enp0s29f1:rx-020:05:150
492678991513,1cyclictest60350irq/132-enp0s29f1:rx-020:05:140
492678991512,2cyclictest689724-21/usr/sbin/munin22:20:250
492678991511,3cyclictest586361-21apt-get20:40:110
492678991510,3cyclictest720793-21cron22:49:590
49268899148,4cyclictest252-21systemd-journal19:29:593
492688991411,2cyclictest814450-21sh00:20:003
492688991411,1cyclictest0-21swapper/321:40:003
492688991410,3cyclictest642260-21ntp_kernel_err21:30:203
492688991410,3cyclictest591035-21journal-offline20:42:213
492688991410,3cyclictest252-21systemd-journal22:14:593
49268699149,4cyclictest252-21systemd-journal21:49:552
49268699149,1cyclictest191rcu_preempt19:40:162
49268699149,1cyclictest191rcu_preempt00:13:322
49268699148,4cyclictest580923-21latency_hist20:35:002
49268699142,2cyclictest834147-21ntpq00:35:242
49268699142,2cyclictest834147-21ntpq00:35:242
49268699142,2cyclictest766327-21ntpq23:30:212
49268699141,3cyclictest605804-21ntpq20:55:212
49268699141,3cyclictest41-21ksoftirqd/223:15:212
49268699141,3cyclictest41-21ksoftirqd/220:35:282
492686991411,1cyclictest191rcu_preempt23:51:482
492686991410,3cyclictest793765-21gpgv00:00:012
492686991410,3cyclictest668646-21kworker/u8:1+flush-259:023:15:012
492686991410,3cyclictest2971-21cron19:55:002
49268699140,6cyclictest700194-21cron22:30:002
49268299149,4cyclictest752158-21diskstats23:20:151
492682991412,1cyclictest606402-21kworker/u8:1+flush-259:021:20:221
492682991411,2cyclictest803814-21kworker/u8:0+flush-259:000:25:171
492682991411,2cyclictest606402-21kworker/u8:1+flush-259:021:00:251
492682991411,2cyclictest492665-21kworker/u8:1+flush-259:019:30:211
492682991410,3cyclictest705190-21kworker/u8:0+flush-259:022:55:201
492678991413,1cyclictest60350irq/132-enp0s29f1:rx-021:58:480
492678991413,1cyclictest60350irq/132-enp0s29f1:rx-021:51:230
492678991413,1cyclictest60350irq/132-enp0s29f1:rx-000:38:490
492678991413,1cyclictest60350irq/132-enp0s29f1:rx-000:38:490
492678991412,1cyclictest60350irq/132-enp0s29f1:rx-023:50:280
492678991412,1cyclictest60350irq/132-enp0s29f1:rx-022:35:270
492678991412,1cyclictest60350irq/132-enp0s29f1:rx-020:55:130
492678991412,1cyclictest60350irq/132-enp0s29f1:rx-020:25:260
492678991410,3cyclictest761770-21kworker/u8:1+flush-259:000:00:220
492688991311,1cyclictest515882-21kthreadcore19:30:173
49268699137,4cyclictest533981-21latency_hist19:50:012
49268699137,4cyclictest0-21swapper/221:34:252
49268699136,3cyclictest0-21swapper/220:08:172
49268699136,3cyclictest0-21swapper/220:08:172
49268699134,2cyclictest0-21swapper/200:25:172
49268699134,1cyclictest191rcu_preempt21:20:242
49268699132,6cyclictest662776-21ntpq21:50:202
49268699132,3cyclictest41-21ksoftirqd/223:35:142
49268699132,2cyclictest704465-21ntpq22:30:232
49268699131,4cyclictest41-21ksoftirqd/219:25:242
49268699131,3cyclictest777826-21dpkg23:45:122
49268699131,3cyclictest41-21ksoftirqd/220:50:222
49268699131,2cyclictest709699-21ntp_states22:35:252
492686991310,2cyclictest523135-21unixbench_multi19:35:262
492686991310,1cyclictest191rcu_preempt20:18:092
49268299139,3cyclictest705190-21kworker/u8:0+events_unbound22:40:241
49268299139,3cyclictest523986-21cut19:40:121
492682991311,1cyclictest537113-21kthreadcore19:50:191
492682991310,2cyclictest783150-21latency_hist23:50:011
492682991310,2cyclictest578313-21kthreadcore20:30:211
492678991312,1cyclictest60350irq/132-enp0s29f1:rx-023:30:150
492678991312,1cyclictest60350irq/132-enp0s29f1:rx-019:16:020
492678991311,2cyclictest60350irq/132-enp0s29f1:rx-023:25:300
492678991311,1cyclictest60350irq/132-enp0s29f1:rx-020:15:140
492678991311,1cyclictest60350irq/132-enp0s29f1:rx-019:45:160
492678991311,1cyclictest549464-21munin-run20:05:000
492678991310,2cyclictest804479-21cpuspeed_turbos00:10:130
492678991310,2cyclictest591602-21cpuspeed_turbos20:45:140
49268899129,2cyclictest806702-21kthreadcore00:10:183
49268899129,2cyclictest505518-21kthreadcore19:20:183
49268899128,3cyclictest507898-21kworker/u8:2+flush-259:019:50:253
49268899121,9cyclictest689496-21awk22:20:003
49268699129,2cyclictest710839-21cpuspeed_turbos22:40:132
49268699129,2cyclictest633327-21fschecks_count21:25:142
49268699128,2cyclictest500-21systemd-logind20:15:012
49268699127,4cyclictest252-21systemd-journal19:19:592
49268699122,3cyclictest41-21ksoftirqd/221:40:122
49268699121,7cyclictest772940-21hddtemp_smartct23:40:152
49268699121,3cyclictest41-21ksoftirqd/200:05:222
49268699121,2cyclictest41-21ksoftirqd/222:50:172
49268699121,2cyclictest41-21ksoftirqd/221:15:192
492686991211,1cyclictest391rcuc/220:41:162
492686991210,1cyclictest391rcuc/222:57:352
492686991210,1cyclictest0-21swapper/220:25:202
49268699120,7cyclictest716238-21hddtemp_smartct22:45:172
49268699120,3cyclictest693768-21ntpq22:20:212
49268299129,2cyclictest762384-21cpuspeed_turbos23:30:131
49268299129,2cyclictest554888-21kworker/u8:3+events_unbound20:15:241
49268299129,2cyclictest528844-21kworker/u8:0+flush-259:019:45:261
49268299129,2cyclictest507-21in:imuxsock23:44:201
49268299126,4cyclictest617357-21base6421:10:011
49268299126,4cyclictest1-21systemd23:15:011
492682991210,1cyclictest497794-21sh19:15:001
492682991210,1cyclictest0-21swapper/120:55:171
492682991210,1cyclictest0-21swapper/119:35:181
492678991211,1cyclictest60350irq/132-enp0s29f1:rx-021:37:320
492678991210,1cyclictest60350irq/132-enp0s29f1:rx-021:30:110
492678991210,1cyclictest60350irq/132-enp0s29f1:rx-019:20:190
49268899118,1cyclictest0-21swapper/322:00:153
49268899115,4cyclictest252-21systemd-journal23:15:013
49268699119,1cyclictest391rcuc/200:30:222
49268699110,7cyclictest503228-21chrt19:20:112
49268299116,4cyclictest252-21systemd-journal20:45:001
49268299116,3cyclictest252-21systemd-journal23:05:001
49268899100,3cyclictest679143-21latency_hist22:10:013
49268299108,1cyclictest0-21swapper/121:15:141
49268299104,4cyclictest252-21systemd-journal22:34:591
4926829995,3cyclictest591537-21apt-get20:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional