You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 11:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Aug 12, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2452200998075,4cyclictest75-21kswapd000:35:023
2452189994642,3cyclictest2452391-21kworker/u8:3+flush-259:019:20:220
2452189994639,5cyclictest2535717-21latency_hist20:30:000
2452194994135,4cyclictest2608473-21latency_hist21:39:591
2452197993832,4cyclictest2676109-21latency_hist22:45:012
2452197993731,4cyclictest335557-21systemd-journal22:33:462
2452194993734,2cyclictest75-21kswapd000:35:031
2452189993730,5cyclictest2775646-21diskstats00:20:140
2452189993730,5cyclictest2503436-21ntpq19:55:220
2452200993630,4cyclictest2685999-21ntpq22:50:223
2452197993629,5cyclictest2462490-21latency_hist19:20:022
2452194993633,2cyclictest2676135-21kworker/u8:2+flush-259:022:55:211
2452194993630,4cyclictest2623984-21http21:55:001
2452189993631,3cyclictest335557-21systemd-journal21:20:480
2452189993529,4cyclictest2452391-21kworker/u8:3+flush-259:019:15:200
2452200993429,3cyclictest2468325-21kworker/u8:4+flush-259:020:40:153
2452189993428,4cyclictest2702632-21/usr/sbin/munin23:10:210
2452189993327,4cyclictest2509572-21kworker/u8:2+flush-259:020:20:170
2452194993229,2cyclictest2644853-21kworker/u8:3+events_unbound22:25:121
2452194993228,2cyclictest2670836-21kworker/u8:1+flush-259:022:50:251
2452194993227,3cyclictest2577230-21/usr/sbin/munin21:10:151
2452197993124,4cyclictest2473294-21latency_hist19:30:012
2452189993126,3cyclictest2468325-21kworker/u8:4+flush-259:020:00:200
2452189993126,3cyclictest1-21systemd21:20:010
2452194993027,2cyclictest2676343-21kworker/u8:4+flush-259:023:15:251
2452189993027,2cyclictest75-21kswapd000:35:020
2452189993022,5cyclictest2639917-21latency_hist22:10:000
2452200992925,3cyclictest2602960-21kworker/u8:2+flush-259:021:50:553
2452200992924,4cyclictest2692303-21apt-get23:00:103
2452200992923,5cyclictest2525232-21kworker/u8:1+flush-259:020:50:153
2452194992926,2cyclictest2644853-21kworker/u8:3+flush-259:022:15:141
2452194992926,2cyclictest2468325-21kworker/u8:4+flush-259:020:35:191
2452194992926,2cyclictest2452391-21kworker/u8:3+flush-259:019:15:251
2452194992923,4cyclictest335557-21systemd-journal21:08:451
2452200992825,2cyclictest2525232-21kworker/u8:1+flush-259:021:10:263
2452200992825,2cyclictest2525232-21kworker/u8:1+events_unbound21:00:193
2452200992824,2cyclictest2525232-21kworker/u8:1+events_unbound21:30:203
2452194992825,2cyclictest2468325-21kworker/u8:4+events_unbound20:52:461
2452194992822,5cyclictest2727302-21ntpq23:30:201
2452200992721,4cyclictest335557-21systemd-journal20:00:013
2452200992721,4cyclictest2494392-21diskstats19:50:113
2452197992722,4cyclictest2764474-21kworker/u8:0+flush-259:000:15:172
2452197992722,3cyclictest335557-21systemd-journal19:30:302
2452194992725,1cyclictest2707754-21kworker/u8:1+events_unbound23:45:221
2452194992725,1cyclictest2602960-21kworker/u8:2+events_unbound21:31:451
2452194992724,2cyclictest2468325-21kworker/u8:4+events_unbound19:30:301
2452194992723,3cyclictest2707754-21kworker/u8:1+events_unbound23:24:561
2452197992621,3cyclictest335557-21systemd-journal23:41:172
2452197992620,4cyclictest2488800-21latency_hist19:45:012
2452197992619,4cyclictest2598154-21latency_hist21:30:012
2452194992622,3cyclictest335557-21systemd-journal23:50:561
2452194992622,3cyclictest2602960-21kworker/u8:2+events_unbound22:00:241
2452194992622,3cyclictest2525232-21kworker/u8:1+flush-259:021:20:251
2452194992620,4cyclictest2655498-21latency_hist22:25:011
2452189992622,3cyclictest2468325-21kworker/u8:4+flush-259:019:45:160
2452189992621,4cyclictest2655540-21kworker/u8:0+flush-259:022:30:260
2452200992522,2cyclictest2655540-21kworker/u8:0+flush-259:022:40:153
2452200992521,3cyclictest2525232-21kworker/u8:1+flush-259:022:05:223
245220099250,24cyclictest1-21systemd21:25:013
2452197992520,3cyclictest335557-21systemd-journal23:58:572
2452197992519,4cyclictest2785572-21latency_hist00:30:002
2452194992522,2cyclictest2452391-21kworker/u8:3+flush-259:019:25:121
2452194992521,3cyclictest2452391-21kworker/u8:3+events_unbound19:20:291
2452194992519,4cyclictest2525339-21latency_hist20:20:001
2452189992518,5cyclictest2790766-21apt-key00:35:000
2452189992517,6cyclictest2701545-21ntpq23:05:250
2452200992421,2cyclictest509-21rs:main3
2452200992420,3cyclictest2525232-21kworker/u8:1+flush-259:020:55:453
2452194992421,2cyclictest2629202-21sshd21:55:461
2452194992421,2cyclictest2525232-21kworker/u8:1+events_unbound21:25:241
2452194992421,2cyclictest2468325-21kworker/u8:4+flush-259:019:40:171
2452194992419,4cyclictest2613632-21latency_hist21:45:001
2452189992417,5cyclictest2478752-21apt-get19:35:120
2452200992319,3cyclictest2676135-21kworker/u8:2+events_unbound22:55:183
2452197992318,3cyclictest507-21in:imuxsock21:15:002
2452194992320,2cyclictest2676343-21kworker/u8:4+events_unbound22:45:241
2452194992320,2cyclictest2488816-21kworker/u8:1+events_unbound19:55:351
2452194992319,3cyclictest2666048-21apt-get22:35:121
2452194992318,4cyclictest2723273-21kworker/u8:3+events_unbound00:29:031
2452194992318,4cyclictest2640155-21/usr/sbin/munin22:10:141
2452189992317,4cyclictest335557-21systemd-journal20:14:590
2452189992316,5cyclictest2758457-21ntpq00:00:230
2452200992220,1cyclictest2452391-21kworker/u8:3+flush-259:019:40:203
2452200992219,2cyclictest2707754-21kworker/u8:1+flush-259:000:09:593
2452200992218,3cyclictest2707754-21kworker/u8:1+events_unbound00:21:273
2452200992218,3cyclictest2399053-21kworker/u8:0+events_unbound19:33:123
2452197992212,9cyclictest335557-21systemd-journal21:35:442
2452194992219,2cyclictest2723273-21kworker/u8:3+flush-259:000:30:231
2452194992218,3cyclictest2535985-21apt-get20:30:131
2452194992217,4cyclictest2753806-21kworker/u8:2+events_unbound00:01:241
2452194992217,3cyclictest509-21rs:main1
2452189992217,3cyclictest2670836-21kworker/u8:1+flush-259:022:40:000
2452189992216,4cyclictest335557-21systemd-journal00:27:030
2452200992118,2cyclictest2655540-21kworker/u8:0+flush-259:022:35:003
2452200992117,3cyclictest2780375-21kworker/u8:0+events_unbound00:26:263
2452200992117,3cyclictest2468325-21kworker/u8:4+events_unbound20:45:443
2452200992115,4cyclictest2540897-21latency_hist20:35:003
2452197992115,4cyclictest2687125-21/usr/sbin/munin22:55:142
2452194992118,2cyclictest2723273-21kworker/u8:3+events_unbound00:19:041
2452194992118,2cyclictest2525232-21kworker/u8:1+events_unbound22:05:591
2452194992118,2cyclictest2525232-21kworker/u8:1+events_unbound20:45:251
2452194992117,3cyclictest2707754-21kworker/u8:1+events_unbound00:07:051
2452194992117,3cyclictest2676135-21kworker/u8:2+events_unbound23:01:571
2452194992115,4cyclictest2570937-21ntpq21:00:221
2452189992117,2cyclictest2712987-21apt-get23:20:100
2452189992116,4cyclictest2676135-21kworker/u8:2+flush-259:023:00:000
2452189992115,4cyclictest2623089-21ntpq21:50:200
2452200992017,2cyclictest2723273-21kworker/u8:3+events_unbound23:51:213
2452200992017,2cyclictest2707540-21kworker/u8:0+events_unbound23:30:013
2452200992016,3cyclictest2644853-21kworker/u8:3+events_unbound22:15:233
2452200992016,3cyclictest2468325-21kworker/u8:4+flush-259:021:05:213
2452200992015,3cyclictest2681494-21store22:50:013
2452197992015,4cyclictest2468325-21kworker/u8:4+flush-259:020:15:172
2452194992016,3cyclictest2468325-21kworker/u8:4+events_unbound20:40:131
2452194992015,4cyclictest2723273-21kworker/u8:3+events_unbound23:44:581
2452189992016,2cyclictest2577255-21apt-get21:10:130
2452189992014,4cyclictest335557-21systemd-journal23:55:010
245220099192,16cyclictest1-21systemd19:29:123
2452200991915,3cyclictest2624165-21kworker/u8:0+events_unbound22:10:133
2452200991914,3cyclictest2452391-21kworker/u8:3+events_unbound19:22:123
2452200991913,4cyclictest2764725-21apt-get00:10:123
245219799190,10cyclictest2775459-21/usr/sbin/munin00:20:122
2452194991916,2cyclictest2692272-21kworker/u8:3+events_unbound23:10:231
2452194991915,3cyclictest2718154-21apt-get23:25:131
2452194991915,3cyclictest2509572-21kworker/u8:2+events_unbound20:20:271
2452200991815,2cyclictest2644853-21kworker/u8:3+flush-259:022:35:173
2452200991815,2cyclictest2525349-21turbostat.cron20:20:003
2452200991814,3cyclictest2525232-21kworker/u8:1+events_unbound22:28:483
2452200991814,3cyclictest2488816-21kworker/u8:1+events_unbound20:00:353
2452200991814,3cyclictest2468325-21kworker/u8:4+events_unbound21:15:233
2452200991813,4cyclictest2468325-21kworker/u8:4+events_unbound19:49:143
2452200991812,4cyclictest335557-21systemd-journal23:35:013
2452194991815,2cyclictest2692272-21kworker/u8:3+events_unbound23:05:271
2452194991815,2cyclictest2525232-21kworker/u8:1+events_unbound20:25:281
2452194991815,2cyclictest2488816-21kworker/u8:1+flush-259:019:50:181
2452194991814,3cyclictest2468325-21kworker/u8:4+events_unbound19:46:141
2452194991814,3cyclictest2441501-21kworker/u8:2+flush-259:019:10:271
2452194991813,4cyclictest2515298-21/usr/sbin/munin20:10:161
2452189991815,2cyclictest2499129-21sh19:55:000
245218999181,15cyclictest509-21rs:main0
2452189991810,6cyclictest335557-21systemd-journal20:54:590
2452200991714,3cyclictest2525232-21kworker/u8:1+events_unbound20:39:463
2452200991713,3cyclictest2780375-21kworker/u8:0+events_unbound00:32:043
2452200991713,3cyclictest2707754-21kworker/u8:1+flush-259:023:45:053
2452200991713,3cyclictest2525232-21kworker/u8:1+events_unbound22:20:463
2452200991713,3cyclictest2468325-21kworker/u8:4+flush-259:020:05:443
2452200991713,3cyclictest2452391-21kworker/u8:3+flush-259:019:35:203
2452197991715,1cyclictest0-21swapper/219:15:012
245219799170,15cyclictest2624311-21latency_hist21:55:002
245219799170,14cyclictest2635724-21irqcore22:05:172
2452194991714,2cyclictest2488816-21kworker/u8:1+flush-259:020:00:281
2452194991714,2cyclictest2452391-21kworker/u8:3+events_unbound19:35:151
2452194991713,3cyclictest2723273-21kworker/u8:3+events_unbound00:20:051
2452194991713,3cyclictest2655540-21kworker/u8:0+events_unbound22:30:141
245218999179,5cyclictest2686892-21latency_hist22:55:010
2452189991713,2cyclictest2655509-21turbostat22:25:000
2452189991712,3cyclictest2551511-21apt-get20:45:130
2452200991612,3cyclictest2723273-21kworker/u8:3+events_unbound00:15:223
2452200991612,3cyclictest2707540-21kworker/u8:0+flush-259:023:15:163
245219799168,6cyclictest0-21swapper/222:15:002
2452197991613,2cyclictest2720448-21kthreadcore23:25:182
2452197991613,2cyclictest2526628-21kthreadcore20:20:182
245219799161,13cyclictest2769616-21cron00:14:592
245219799161,13cyclictest2562253-21irqcore20:55:162
245219799161,12cyclictest2651014-21grep22:20:162
245219799160,9cyclictest2482594-21memory19:35:192
245219799160,8cyclictest2634561-21taskset22:02:392
245219799160,14cyclictest2744399-21sed23:50:162
245219799160,14cyclictest2598629-21tune2fs21:30:152
245219799160,14cyclictest2576994-21latency_hist21:10:012
245219799160,14cyclictest2540892-21cron20:34:592
245219799160,14cyclictest2498193-21/usr/sbin/munin19:50:182
245219799160,13cyclictest2754491-21cpuspeed_turbos00:00:142
245219799160,13cyclictest2738940-21tr23:45:152
245219799160,13cyclictest2541236-21tr20:35:162
245219499168,3cyclictest2602960-21kworker/u8:2+events_unbound21:45:231
2452194991613,2cyclictest2707754-21kworker/u8:1+events_unbound00:10:221
2452194991612,3cyclictest2723273-21kworker/u8:3+events_unbound23:36:561
245218999168,5cyclictest2681306-21https22:50:000
2452189991613,2cyclictest60350irq/132-enp0s29f1:rx-022:29:260
2452189991613,2cyclictest60350irq/132-enp0s29f1:rx-022:10:110
2452189991613,1cyclictest0-21swapper/023:40:000
2452189991611,3cyclictest2775084-21store00:20:000
2452200991512,2cyclictest0-21swapper/319:20:013
2452200991511,3cyclictest2707754-21kworker/u8:1+events_unbound23:20:243
2452200991511,3cyclictest2525232-21kworker/u8:1+flush-259:021:29:143
2452200991511,3cyclictest2525232-21kworker/u8:1+events_unbound21:40:443
2452200991511,2cyclictest2452417-21apt-get19:10:113
245219799159,4cyclictest2733402-21latency_hist23:40:012
245219799155,9cyclictest513-21gdbus22:40:002
245219799153,10cyclictest2532118-21cut20:25:192
245219799152,12cyclictest2682953-21sed22:50:172
2452197991512,2cyclictest2613651-21kworker/u8:3+flush-259:021:50:002
245219799151,13cyclictest2786275-21tr00:30:162
2452197991511,3cyclictest2645408-21apt-get22:15:132
2452197991511,2cyclictest509-21rs:main2
245219799151,12cyclictest2676857-21sed22:45:162
245219799151,12cyclictest2570867-21strings21:00:212
245219799151,12cyclictest2509151-21ps20:00:272
245219799151,12cyclictest2467650-21sh19:24:592
245219799151,12cyclictest0-21swapper/220:50:002
245219799151,11cyclictest2592086-21ntpq21:20:242
245219799150,13cyclictest2655872-21cpuspeed_turbos22:25:112
245219799150,13cyclictest2629578-21cut22:00:002
245219799150,13cyclictest2504284-21cron20:00:002
245219799150,12cyclictest2723382-21cpuspeed_turbos23:30:132
245219799150,12cyclictest2609146-21ps21:40:172
2452194991511,3cyclictest2655540-21kworker/u8:0+flush-259:022:41:071
2452194991511,3cyclictest2468325-21kworker/u8:4+flush-259:021:17:111
2452189991513,2cyclictest61150irq/133-enp0s29f1:tx-000:05:150
2452189991513,1cyclictest60350irq/132-enp0s29f1:rx-022:41:090
2452189991513,1cyclictest60350irq/132-enp0s29f1:rx-020:17:520
2452189991512,2cyclictest60350irq/132-enp0s29f1:rx-022:15:060
2452189991512,2cyclictest2728222-21sh23:35:000
2452189991512,2cyclictest2468325-21kworker/u8:4+flush-259:020:30:150
2452189991511,3cyclictest60350irq/132-enp0s29f1:rx-023:00:110
2452189991511,3cyclictest2593495-21fschecks_time21:25:160
2452189991510,4cyclictest2468325-21kworker/u8:4+flush-259:019:30:130
2452200991411,2cyclictest2723273-21kworker/u8:3+events_unbound23:55:213
2452200991410,3cyclictest2723273-21kworker/u8:3+events_unbound23:41:183
2452200991410,3cyclictest2509572-21kworker/u8:2+events_unbound20:10:163
2452197991411,2cyclictest2713209-21fschecks_time23:20:132
245219799141,11cyclictest2764442-21cron00:09:592
245219799141,11cyclictest2586888-21ld21:15:212
245219799140,12cyclictest2700510-21cut23:05:212
245219799140,12cyclictest2489163-21tr19:45:122
245219499149,3cyclictest2468325-21kworker/u8:4+flush-259:020:08:551
2452189991413,1cyclictest60350irq/132-enp0s29f1:rx-022:04:390
2452189991412,2cyclictest60350irq/132-enp0s29f1:rx-020:39:340
2452189991412,1cyclictest60350irq/132-enp0s29f1:rx-023:40:240
2452189991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:200
2452189991412,1cyclictest60350irq/132-enp0s29f1:rx-021:00:160
2452189991411,2cyclictest60350irq/132-enp0s29f1:rx-021:40:540
245220099139,3cyclictest2602960-21kworker/u8:2+events_unbound21:45:213
245220099139,3cyclictest2509572-21kworker/u8:2+events_unbound20:20:453
2452189991311,1cyclictest60350irq/132-enp0s29f1:rx-023:55:180
2452189991311,1cyclictest60350irq/132-enp0s29f1:rx-021:09:090
2452189991311,1cyclictest60350irq/132-enp0s29f1:rx-019:40:170
2452189991310,2cyclictest60350irq/132-enp0s29f1:rx-020:55:260
2452189991310,2cyclictest60350irq/132-enp0s29f1:rx-019:25:220
2452189991310,2cyclictest60350irq/132-enp0s29f1:rx-019:10:200
245220099129,2cyclictest2626960-21kthreadcore21:55:193
245220099129,2cyclictest0-21swapper/320:30:003
245218999129,2cyclictest2614909-21kthreadcore21:45:170
245220099119,1cyclictest2602960-21kworker/u8:2+events_unbound22:00:143
245220099118,2cyclictest2702657-21apt-get23:10:123
245220099117,3cyclictest2723273-21kworker/u8:3+events_unbound23:35:233
245218999118,2cyclictest60350irq/132-enp0s29f1:rx-023:19:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional