You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 10:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu May 07, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2838356994137,3cyclictest2890442-21apt-get20:00:110
2838366993933,4cyclictest252-21systemd-journal23:35:013
2838358993935,3cyclictest3134256-21kworker/u8:1+flush-259:023:55:221
2838358993834,3cyclictest2864062-21kworker/u8:0+flush-259:020:10:211
2838358993831,5cyclictest3009707-21latency_hist21:55:001
2838356993832,4cyclictest2864018-21latency_hist19:35:010
2838361993732,4cyclictest3134256-21kworker/u8:1+flush-259:000:13:282
2838356993733,3cyclictest2864283-21apt-get19:35:110
2838358993632,3cyclictest2931310-21kworker/u8:2+events_unbound20:40:201
2838358993532,2cyclictest3124034-21kworker/u8:2+events_unbound23:45:131
2838366993428,4cyclictest2838326-21kworker/u8:2+flush-259:019:30:003
2838366993428,4cyclictest2838326-21kworker/u8:2+flush-259:019:30:003
2838358993430,3cyclictest2890203-21kworker/u8:1+events_unbound20:31:501
2838358993429,3cyclictest2853766-21kworker/u8:1+events_unbound19:45:161
2838361993329,3cyclictest3046670-21kworker/u8:3+flush-259:023:00:222
2838361993327,4cyclictest3165561-21latency_hist00:25:002
2838358993330,2cyclictest2853766-21kworker/u8:1+flush-259:019:35:241
2838358993327,4cyclictest2952174-21kworker/u8:3+flush-259:021:05:211
2838358993228,3cyclictest3176452-21kworker/u8:4+events_unbound00:35:201
2838358993228,3cyclictest3046670-21kworker/u8:3+events_unbound23:05:011
2838358993127,3cyclictest2988676-21kworker/u8:1+events_unbound21:40:161
2838358993027,2cyclictest2977951-21kworker/u8:0+events_unbound22:55:241
2838358993026,3cyclictest2880110-21kworker/u8:3+events_unbound20:08:481
2838366992922,5cyclictest3082853-21latency_hist23:05:013
2838358992926,2cyclictest2977951-21kworker/u8:0+events_unbound22:35:141
2838358992925,3cyclictest2977951-21kworker/u8:0+events_unbound22:50:191
2838358992925,3cyclictest2931310-21kworker/u8:2+flush-259:021:20:201
2838358992923,3cyclictest2780498-21kworker/u8:0+events_unbound19:10:141
2838358992825,2cyclictest3098251-21kworker/u8:3+events_unbound00:10:201
2838358992825,2cyclictest3098251-21kworker/u8:3+events_unbound00:00:251
2838358992825,2cyclictest3036362-21kworker/u8:2+events_unbound22:20:091
2838358992824,3cyclictest3098251-21kworker/u8:3+events_unbound23:50:221
2838358992823,3cyclictest2977951-21kworker/u8:0+events_unbound23:20:161
2838358992821,4cyclictest2957277-21latency_hist21:05:001
2838356992824,3cyclictest2838565-21apt-get19:10:110
2838356992821,5cyclictest3026200-21cp22:10:010
2838356992821,5cyclictest3026200-21cp22:10:010
2838366992723,3cyclictest2890203-21kworker/u8:1+flush-259:021:20:003
2838366992720,5cyclictest2993856-21gpgv21:40:003
2838361992720,5cyclictest252-21systemd-journal19:47:482
2838361992719,6cyclictest3025645-21latency_hist22:10:002
2838358992724,2cyclictest2977951-21kworker/u8:0+events_unbound21:45:151
2838358992724,2cyclictest2890203-21kworker/u8:1+events_unbound20:15:481
2838358992724,2cyclictest2853766-21kworker/u8:1+events_unbound19:30:151
2838358992723,3cyclictest776459-21kworker/u8:3+events_unbound19:15:171
2838356992723,3cyclictest3098251-21kworker/u8:3+events_unbound00:20:150
2838356992722,4cyclictest3153914-21ntpq00:10:190
2838366992622,3cyclictest2890203-21kworker/u8:1+flush-259:020:50:223
2838366992619,4cyclictest3062206-21latency_hist22:45:003
2838358992624,2cyclictest2838326-21kworker/u8:2+flush-259:019:25:201
2838358992624,2cyclictest2838326-21kworker/u8:2+flush-259:019:25:191
2838358992622,3cyclictest3160637-21kworker/u8:0+events_unbound00:25:211
2838358992621,4cyclictest3170721-21kworker/u8:2+flush-259:000:30:211
2838358992620,4cyclictest2977951-21kworker/u8:0+events_unbound23:40:181
2838356992620,5cyclictest252-21systemd-journal20:55:000
2838366992518,5cyclictest509-21rs:main3
2838358992523,1cyclictest2977951-21kworker/u8:0+events_unbound22:10:211
2838358992523,1cyclictest2977951-21kworker/u8:0+events_unbound22:10:201
2838358992522,2cyclictest2890203-21kworker/u8:1+events_unbound21:10:241
2838358992522,2cyclictest2880110-21kworker/u8:3+events_unbound20:35:171
2838358992522,2cyclictest2864062-21kworker/u8:0+flush-259:020:00:141
2838358992521,3cyclictest2853766-21kworker/u8:1+events_unbound19:40:321
2838356992521,3cyclictest3098251-21kworker/u8:3+flush-259:023:25:000
2838356992519,4cyclictest2889335-21ntpq19:55:210
2838366992420,3cyclictest2864062-21kworker/u8:0+flush-259:020:00:013
2838358992420,3cyclictest3046670-21kworker/u8:3+events_unbound23:05:141
2838358992420,3cyclictest2977951-21kworker/u8:0+events_unbound21:30:091
2838358992420,3cyclictest2880110-21kworker/u8:3+flush-259:019:55:211
2838361992317,4cyclictest3149670-21latency_hist00:10:002
2838358992319,3cyclictest3134256-21kworker/u8:1+flush-259:000:15:011
2838358992319,3cyclictest2988676-21kworker/u8:1+events_unbound21:35:201
2838358992317,4cyclictest3020491-21latency_hist22:05:001
2838366992215,5cyclictest3045757-21ntpq22:25:213
2838358992219,2cyclictest3077736-21kworker/u8:1+events_unbound23:15:241
2838358992219,2cyclictest2890203-21kworker/u8:1+flush-259:020:50:161
2838358992219,2cyclictest2838326-21kworker/u8:2+events_unbound19:50:181
2838358992218,3cyclictest2916034-21kworker/u8:0+events_unbound20:45:521
2838356992215,5cyclictest252-21systemd-journal19:21:470
2838356992215,5cyclictest252-21systemd-journal19:21:460
2838356992214,6cyclictest3051011-21ntpq22:30:220
2838366992116,4cyclictest2853766-21kworker/u8:1+flush-259:019:30:253
2838361992115,5cyclictest2977915-21latency_hist21:25:002
2838358992118,2cyclictest2977951-21kworker/u8:0+events_unbound23:25:241
2838358992114,5cyclictest2978566-21store21:25:011
2838366992017,2cyclictest3031225-21latency_hist22:15:013
2838366992017,2cyclictest3031225-21latency_hist22:15:003
2838366992013,6cyclictest2936650-21latency_hist20:45:013
2838358992018,1cyclictest2977951-21kworker/u8:0+events_unbound22:19:591
2838358992017,2cyclictest2952174-21kworker/u8:3+flush-259:021:15:201
2838358992016,3cyclictest3134256-21kworker/u8:1+flush-259:000:05:161
2838358992016,3cyclictest3098251-21kworker/u8:3+events_unbound00:23:301
2838356992016,3cyclictest2988676-21kworker/u8:1+flush-259:021:40:000
2838356992015,4cyclictest3041800-21apt-get22:25:110
2838356992015,3cyclictest2977951-21kworker/u8:0+flush-259:022:40:150
2838366991913,4cyclictest3088205-21/usr/sbin/munin23:10:123
2838361991915,3cyclictest2853766-21kworker/u8:1+flush-259:019:45:002
2838361991915,2cyclictest2952174-21kworker/u8:3+events_unbound21:15:182
2838361991912,5cyclictest252-21systemd-journal23:47:522
2838358991916,2cyclictest3098251-21kworker/u8:3+events_unbound23:30:201
2838358991916,2cyclictest2977951-21kworker/u8:0+flush-259:022:25:231
2838358991916,2cyclictest2838326-21kworker/u8:2+events_unbound19:20:141
2838358991916,2cyclictest2838326-21kworker/u8:2+events_unbound19:20:141
2838358991915,3cyclictest3046670-21kworker/u8:3+events_unbound22:41:511
2838358991915,3cyclictest2977951-21kworker/u8:0+events_unbound23:35:151
2838356991913,4cyclictest3148769-21ntpq00:05:200
2838366991815,2cyclictest2977951-21kworker/u8:0+flush-259:023:40:163
2838366991814,3cyclictest509-21rs:main3
2838366991811,5cyclictest2910889-21latency_hist20:20:013
2838361991814,2cyclictest3042816-21kthreadcore22:25:172
2838361991814,2cyclictest0-21swapper/221:40:002
2838361991812,4cyclictest252-21systemd-journal23:30:002
2838358991815,2cyclictest3046670-21kworker/u8:3+flush-259:022:45:531
2838358991815,2cyclictest2977951-21kworker/u8:0+events_unbound22:30:141
2838358991814,3cyclictest3087995-21kworker/u8:2+flush-259:023:10:121
2838358991814,2cyclictest0-21swapper/122:00:001
2838356991815,2cyclictest3057043-21idleruntime-cro22:40:000
2838356991814,3cyclictest252-21systemd-journal19:44:480
2838356991813,3cyclictest2890203-21kworker/u8:1+flush-259:021:10:160
2838356991812,4cyclictest252-21systemd-journal21:30:000
2838366991714,2cyclictest3103410-21turbostat23:25:013
2838366991713,2cyclictest3149669-21turbostat00:09:593
2838366991712,3cyclictest2890203-21kworker/u8:1+flush-259:021:10:003
2838366991711,4cyclictest2926363-21latency_hist20:35:013
2838361991710,5cyclictest2952576-21diskstats21:00:152
2838358991714,2cyclictest2880110-21kworker/u8:3+events_unbound20:25:491
2838366991611,3cyclictest252-21systemd-journal22:22:513
2838366991610,4cyclictest2977951-21kworker/u8:0+flush-259:022:50:003
2838356991614,1cyclictest60350irq/132-enp0s29f1:rx-022:22:280
2838356991614,1cyclictest60350irq/132-enp0s29f1:rx-020:17:190
2838356991613,2cyclictest60350irq/132-enp0s29f1:rx-020:40:250
2838356991613,2cyclictest60350irq/132-enp0s29f1:rx-020:20:110
2838356991613,2cyclictest2918494-21kthreadcore20:25:180
2838356991612,3cyclictest60350irq/132-enp0s29f1:rx-021:30:120
2838366991512,2cyclictest3175838-21idleruntime-cro00:34:593
2838366991512,2cyclictest2952174-21kworker/u8:3+flush-259:021:30:003
2838366991512,2cyclictest0-21swapper/300:20:003
2838366991511,3cyclictest3021170-21irqcore22:05:153
2838366991511,3cyclictest2880110-21kworker/u8:3+flush-259:020:21:483
283836199153,7cyclictest2916016-21apt20:25:002
2838361991513,1cyclictest2921210-21munin-plugin-st20:30:012
2838361991512,2cyclictest3140049-21irqcore00:00:172
2838361991510,3cyclictest3015384-21base6422:00:012
2838358991513,2cyclictest2977951-21kworker/u8:0+events_unbound22:08:521
283835699157,6cyclictest3169796-21ntpq00:25:200
2838356991514,1cyclictest60350irq/132-enp0s29f1:rx-021:59:310
2838356991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:160
2838356991513,1cyclictest60350irq/132-enp0s29f1:rx-022:50:220
2838356991513,1cyclictest60350irq/132-enp0s29f1:rx-021:45:230
2838356991513,1cyclictest60350irq/132-enp0s29f1:rx-021:15:160
2838356991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:160
2838356991513,1cyclictest60350irq/132-enp0s29f1:rx-000:00:120
2838356991513,1cyclictest0-21swapper/019:50:010
2838356991512,2cyclictest60350irq/132-enp0s29f1:rx-023:38:290
2838356991512,2cyclictest60350irq/132-enp0s29f1:rx-020:35:150
2838356991512,2cyclictest60350irq/132-enp0s29f1:rx-019:25:170
2838356991512,2cyclictest60350irq/132-enp0s29f1:rx-019:25:170
283836699148,4cyclictest2885038-21latency_hist19:55:013
2838366991411,2cyclictest3168096-21kthreadcore00:25:183
2838366991411,2cyclictest2953437-21kthreadcore21:00:193
2838366991411,2cyclictest2895827-21fschecks_time20:05:153
2838366991410,3cyclictest3098251-21kworker/u8:3+flush-259:023:40:013
2838361991411,2cyclictest3155647-21cpuspeed_turbos00:15:122
2838361991411,2cyclictest3013888-21needreboot21:55:202
2838358991411,2cyclictest2890203-21kworker/u8:1+flush-259:020:55:011
2838356991413,1cyclictest60350irq/132-enp0s29f1:rx-023:54:230
2838356991413,1cyclictest60350irq/132-enp0s29f1:rx-023:00:130
2838356991413,1cyclictest60350irq/132-enp0s29f1:rx-022:56:000
2838356991413,1cyclictest60350irq/132-enp0s29f1:rx-019:15:220
2838356991412,1cyclictest60350irq/132-enp0s29f1:rx-023:55:120
2838356991412,1cyclictest60350irq/132-enp0s29f1:rx-023:25:180
2838356991412,1cyclictest60350irq/132-enp0s29f1:rx-023:10:340
2838356991412,1cyclictest60350irq/132-enp0s29f1:rx-023:05:130
2838356991412,1cyclictest60350irq/132-enp0s29f1:rx-021:20:010
2838356991412,1cyclictest60350irq/132-enp0s29f1:rx-021:00:150
2838356991411,2cyclictest60350irq/132-enp0s29f1:rx-023:40:190
2838356991411,2cyclictest60350irq/132-enp0s29f1:rx-022:05:100
2838356991411,2cyclictest60350irq/132-enp0s29f1:rx-022:00:270
2838356991411,2cyclictest60350irq/132-enp0s29f1:rx-000:35:150
2838356991411,2cyclictest2923761-21kthreadcore20:30:180
283836699139,3cyclictest3134256-21kworker/u8:1+flush-259:000:13:303
283836699139,3cyclictest2988676-21kworker/u8:1+flush-259:021:35:003
283836699139,3cyclictest2880110-21kworker/u8:3+events_unbound20:35:233
283836699138,4cyclictest2994515-21apt-get21:40:113
283836699138,3cyclictest2853766-21kworker/u8:1+flush-259:019:40:003
283836699137,5cyclictest3052396-21uniq22:35:133
283836699136,5cyclictest2848867-21apt-get19:20:113
283836699136,5cyclictest2848867-21apt-get19:20:103
2838366991310,1cyclictest0-21swapper/319:50:013
283836199136,5cyclictest2957703-21diskstats21:05:142
283836199136,5cyclictest252-21systemd-journal20:05:002
2838361991310,2cyclictest500-21systemd-logind22:55:012
2838361991310,2cyclictest3170681-21munin-plugin-st00:30:002
2838361991310,2cyclictest3062467-21apt-get22:45:112
2838361991310,2cyclictest2984169-21irqcore21:30:142
2838361991310,2cyclictest2885368-21cpuspeed_turbos19:55:112
2838358991310,2cyclictest2890203-21kworker/u8:1+flush-259:020:20:231
2838356991312,1cyclictest60350irq/132-enp0s29f1:rx-023:45:130
2838356991311,2cyclictest60350irq/132-enp0s29f1:rx-020:10:090
2838356991311,1cyclictest60350irq/132-enp0s29f1:rx-019:50:090
2838356991310,2cyclictest60350irq/132-enp0s29f1:rx-000:15:200
283836699129,2cyclictest3103744-21cpuspeed_turbos23:25:143
283836699127,3cyclictest0-21swapper/300:24:593
283836699126,4cyclictest252-21systemd-journal20:50:013
283836699125,5cyclictest252-21systemd-journal22:35:003
2838366991210,1cyclictest0-21swapper/322:15:173
283836199129,2cyclictest3180543-21unixbench_singl00:35:232
283836199129,2cyclictest2849276-21irqcore19:20:162
283836199129,2cyclictest2849276-21irqcore19:20:152
283836199129,2cyclictest0-21swapper/220:15:202
283836199128,3cyclictest3123090-21ntp_kernel_pll_23:40:202
283836199128,2cyclictest0-21swapper/223:00:002
283836199126,4cyclictest2921460-21apt-get20:30:112
283836199121,2cyclictest2864015-21awk19:35:002
2838361991210,1cyclictest0-21swapper/221:00:002
2838361991210,1cyclictest0-21swapper/219:55:002
283835699129,2cyclictest2994714-21fschecks_count21:40:130
283835699127,4cyclictest252-21systemd-journal21:51:510
2838356991210,2cyclictest60350irq/132-enp0s29f1:rx-021:06:010
2838356991210,1cyclictest60350irq/132-enp0s29f1:rx-000:30:120
283836699118,2cyclictest2963692-21kthreadcore21:10:173
283836699117,3cyclictest2890203-21kworker/u8:1+flush-259:020:10:233
283836699116,3cyclictest2780498-21kworker/u8:0+events_unbound19:10:213
283836199118,2cyclictest3026465-21cpuspeed_turbos22:10:122
283836199118,2cyclictest3026465-21cpuspeed_turbos22:10:122
283836199118,2cyclictest2936199-21unixbench_singl20:40:232
283836199118,1cyclictest0-21swapper/223:15:002
283836199111,6cyclictest2900562-21basename20:10:002
283836699107,2cyclictest3020077-21unixbench_singl22:00:273
283836699104,4cyclictest3139805-21diskstats00:00:153
283836699100,8cyclictest3005802-21sed21:50:163
283836199107,2cyclictest3114042-21cpuspeed_turbos23:35:122
283836199104,4cyclictest252-21systemd-journal23:55:002
283836199101,2cyclictest3175837-21latency_hist00:35:002
283836199100,4cyclictest30844861kthreadcore23:05:172
28383669997,1cyclictest0-21swapper/322:55:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional