You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 23:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed Sep 16, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
519575995148,2cyclictest550530-21kworker/u8:0+flush-259:008:10:240
519575994542,2cyclictest550530-21kworker/u8:0+flush-259:008:50:260
519575994339,3cyclictest832300-21kworker/u8:3+events_unbound12:35:010
519583994135,4cyclictest738607-21apt-key10:40:012
519583994035,4cyclictest857772-21kworker/u8:2+flush-259:012:35:002
519583993935,3cyclictest628827-21kworker/u8:2+events_unbound09:45:022
519583993935,3cyclictest628827-21kworker/u8:2+events_unbound09:45:022
519575993936,2cyclictest659469-21kworker/u8:1+flush-259:009:35:000
519575993936,2cyclictest659469-21kworker/u8:1+flush-259:009:35:000
51957599390,37cyclictest1-21systemd12:05:000
519583993834,3cyclictest634674-21kworker/u8:0+flush-259:009:15:242
519583993833,3cyclictest634039-21apt-get09:00:122
519583993833,3cyclictest623684-21apt-get08:50:122
519575993835,2cyclictest607939-21kworker/u8:3+flush-259:009:00:000
519586993727,4cyclictest566302-21latency_hist07:55:013
519583993734,2cyclictest780480-21kworker/u8:3+events_unbound11:20:252
519579993733,3cyclictest758736-21kworker/u8:0+flush-259:011:00:191
519579993732,3cyclictest530381-21apt-get07:20:111
519579993529,4cyclictest686555-21apt-get09:50:101
519583993330,2cyclictest530157-21kworker/u8:3+flush-259:007:35:262
519583993329,3cyclictest706904-21kworker/u8:2+flush-259:010:15:242
519575993329,3cyclictest613396-21apt-get08:40:130
519575993325,6cyclictest335557-21systemd-journal11:05:010
519586993227,3cyclictest826665-21kworker/u8:0+flush-259:012:40:013
519579993228,3cyclictest758736-21kworker/u8:0+flush-259:011:05:251
519575993228,3cyclictest634674-21kworker/u8:0+flush-259:009:05:210
519583993126,4cyclictest335557-21systemd-journal09:56:342
519575993128,2cyclictest722158-21kworker/u8:0+events_unbound10:25:010
519586993024,4cyclictest556225-21apt-get07:45:103
519583992925,3cyclictest712189-21kworker/u8:3+flush-259:010:50:222
519579992925,3cyclictest597244-21kworker/u8:2+flush-259:008:30:141
519579992924,3cyclictest530157-21kworker/u8:3+flush-259:007:35:251
519575992926,2cyclictest706904-21kworker/u8:2+flush-259:010:10:240
519575992926,2cyclictest509134-21kworker/u8:0+events_unbound07:25:250
519575992922,5cyclictest335557-21systemd-journal10:32:340
519586992822,4cyclictest659649-21latency_hist09:25:003
519586992821,5cyclictest738568-21cat10:40:013
519586992821,5cyclictest675797-21/usr/sbin/munin09:40:153
519583992824,3cyclictest530157-21kworker/u8:3+flush-259:007:55:272
519583992823,3cyclictest769514-21kworker/u8:1+events_unbound12:15:192
519575992824,3cyclictest832300-21kworker/u8:3+events_unbound12:10:170
519575992824,3cyclictest669627-21kworker/u8:0+events_unbound09:45:280
519575992824,3cyclictest669627-21kworker/u8:0+events_unbound09:45:270
519575992824,3cyclictest597244-21kworker/u8:2+events_unbound08:25:120
519575992824,3cyclictest576866-21apt-get08:05:110
519575992823,3cyclictest780480-21kworker/u8:3+flush-259:011:55:230
519579992720,5cyclictest335557-21systemd-journal09:25:001
519575992724,2cyclictest748791-21kworker/u8:2+events_unbound11:30:180
519583992623,2cyclictest769514-21kworker/u8:1+events_unbound12:05:152
519579992621,4cyclictest587175-21apt-get08:15:131
519575992623,2cyclictest712189-21kworker/u8:3+flush-259:010:45:180
519575992623,2cyclictest481681-21kworker/u8:1+flush-259:007:20:180
519575992623,2cyclictest481681-21kworker/u8:1+flush-259:007:15:160
519575992622,3cyclictest659469-21kworker/u8:1+flush-259:009:25:180
519575992622,3cyclictest628827-21kworker/u8:2+events_unbound09:02:470
519575992621,4cyclictest701426-21kworker/u8:1+events_unbound10:09:360
519586992518,5cyclictest335557-21systemd-journal09:50:013
519586992518,5cyclictest335557-21systemd-journal09:50:013
519583992522,2cyclictest748791-21kworker/u8:2+events_unbound11:25:232
519579992521,3cyclictest748791-21kworker/u8:2+flush-259:011:30:251
519579992519,4cyclictest826665-21kworker/u8:0+flush-259:012:15:001
519579992519,4cyclictest801500-21/usr/sbin/munin11:40:191
519586992417,5cyclictest550530-21kworker/u8:0+flush-259:008:15:183
519583992420,3cyclictest712189-21kworker/u8:3+flush-259:010:55:242
519583992420,3cyclictest550530-21kworker/u8:0+events_unbound07:47:382
519583992419,3cyclictest780480-21kworker/u8:3+events_unbound11:45:192
519579992420,3cyclictest669627-21kworker/u8:0+flush-259:009:55:171
519579992420,2cyclictest639237-21apt-get09:05:111
519579992419,3cyclictest712412-21/usr/sbin/munin10:15:151
519575992421,2cyclictest706904-21kworker/u8:2+flush-259:010:15:210
519575992420,3cyclictest769514-21kworker/u8:1+events_unbound12:05:220
519583992319,3cyclictest769514-21kworker/u8:1+flush-259:012:20:162
519583992318,3cyclictest481681-21kworker/u8:1+events_unbound07:20:172
519583992317,4cyclictest581763-21latency_hist08:10:002
519579992320,2cyclictest550530-21kworker/u8:0+flush-259:008:05:251
519575992320,2cyclictest769514-21kworker/u8:1+flush-259:012:15:210
519575992320,2cyclictest550530-21kworker/u8:0+events_unbound08:15:140
519575992319,3cyclictest758736-21kworker/u8:0+flush-259:011:05:230
519575992319,3cyclictest607939-21kworker/u8:3+flush-259:009:10:160
519575992319,3cyclictest550530-21kworker/u8:0+flush-259:007:40:210
51958699226,4cyclictest612228-21ld08:35:213
51958699225,6cyclictest617395-21gcc08:40:223
519583992219,2cyclictest748791-21kworker/u8:2+flush-259:011:30:172
519583992219,2cyclictest748791-21kworker/u8:2+events_unbound11:15:232
519583992218,3cyclictest769514-21kworker/u8:1+events_unbound12:10:132
519583992218,3cyclictest706904-21kworker/u8:2+flush-259:010:10:162
519583992218,3cyclictest481681-21kworker/u8:1+events_unbound07:30:242
519583992216,4cyclictest738043-21latency_hist10:40:012
519579992218,3cyclictest857772-21kworker/u8:2+flush-259:012:38:341
519579992217,3cyclictest335557-21systemd-journal07:20:011
519575992219,2cyclictest780480-21kworker/u8:3+events_unbound11:21:350
519575992219,2cyclictest669627-21kworker/u8:0+flush-259:009:35:240
519575992219,2cyclictest550530-21kworker/u8:0+flush-259:008:20:150
519575992217,4cyclictest628827-21kworker/u8:2+events_unbound10:00:170
519575992217,3cyclictest712189-21kworker/u8:3+events_unbound10:50:150
519575992215,5cyclictest738704-21/usr/sbin/munin10:40:200
519586992117,3cyclictest607939-21kworker/u8:3+flush-259:008:50:013
519586992114,4cyclictest649336-21latency_hist09:15:013
519583992118,2cyclictest832300-21kworker/u8:3+events_unbound12:25:202
519583992117,3cyclictest634674-21kworker/u8:0+flush-259:009:20:282
519583992117,2cyclictest669627-21kworker/u8:0+flush-259:009:40:242
519579992117,3cyclictest769514-21kworker/u8:1+flush-259:012:20:251
519579992116,3cyclictest335557-21systemd-journal07:45:341
519575992118,2cyclictest628827-21kworker/u8:2+events_unbound09:50:160
519575992118,2cyclictest550530-21kworker/u8:0+events_unbound07:45:230
519575992118,2cyclictest530157-21kworker/u8:3+events_unbound07:55:200
519575992117,3cyclictest748791-21kworker/u8:2+flush-259:011:18:350
519575992114,5cyclictest805522-21ntpq11:40:200
51958699205,4cyclictest815861-21ntpq11:50:203
51958699205,4cyclictest763432-21modprobe11:00:223
519586992015,4cyclictest769514-21kworker/u8:1+flush-259:012:15:173
519586992013,4cyclictest335557-21systemd-journal10:40:013
519579992017,2cyclictest816755-21cron11:55:001
519579992017,2cyclictest753937-21cron10:55:011
519579992017,2cyclictest675553-21sh09:39:591
519579992016,3cyclictest816793-21kworker/u8:2+flush-259:012:05:001
519579992016,3cyclictest566560-21apt-get07:55:111
519579992014,4cyclictest837696-21/usr/sbin/munin12:15:161
519575992017,2cyclictest780480-21kworker/u8:3+flush-259:011:45:200
519575992016,3cyclictest780480-21kworker/u8:3+flush-259:011:50:200
519575992016,3cyclictest748791-21kworker/u8:2+events_unbound11:10:220
519575992016,3cyclictest701426-21kworker/u8:1+events_unbound10:35:280
51958699197,2cyclictest768602-21ntpq11:05:223
519586991916,2cyclictest628592-21sh08:55:003
519583991916,2cyclictest634674-21kworker/u8:0+flush-259:009:05:192
519583991915,3cyclictest607939-21kworker/u8:3+events_unbound09:10:192
519583991915,2cyclictest0-21swapper/210:50:002
519583991914,3cyclictest706999-21latency_hist10:10:012
519583991913,4cyclictest769493-21latency_hist11:10:012
519579991915,3cyclictest780480-21kworker/u8:3+flush-259:011:35:221
519579991915,3cyclictest550530-21kworker/u8:0+flush-259:008:35:261
519579991914,4cyclictest743860-21apt-get10:45:121
519575991915,3cyclictest748791-21kworker/u8:2+flush-259:011:25:250
519575991911,6cyclictest696631-21latency_hist10:00:010
519586991813,4cyclictest712189-21kworker/u8:3+flush-259:010:25:003
519586991813,4cyclictest649597-21apt-get09:15:123
519586991812,4cyclictest827053-21latency_hist12:05:003
519583991814,3cyclictest748791-21kworker/u8:2+events_unbound11:04:282
519583991813,4cyclictest592066-21latency_hist08:20:012
519583991813,3cyclictest530157-21kworker/u8:3+flush-259:008:00:162
519579991815,2cyclictest748791-21kworker/u8:2+flush-259:011:10:281
519579991814,3cyclictest701426-21kworker/u8:1+flush-259:010:30:261
519579991813,3cyclictest722772-21apt-get10:25:111
519579991812,5cyclictest335557-21systemd-journal12:33:341
519579991811,5cyclictest555111-21ntpq07:40:211
519575991815,2cyclictest826665-21kworker/u8:0+events_unbound12:35:150
519575991815,2cyclictest550530-21kworker/u8:0+events_unbound08:35:190
519575991814,3cyclictest722158-21kworker/u8:0+events_unbound10:25:160
519575991814,3cyclictest634674-21kworker/u8:0+events_unbound09:20:220
519575991814,3cyclictest550530-21kworker/u8:0+events_unbound07:53:200
519575991814,3cyclictest530157-21kworker/u8:3+events_unbound07:37:340
519575991814,3cyclictest481681-21kworker/u8:1+events_unbound07:10:030
51958699176,10cyclictest535298-21latency_hist07:25:013
51958699175,7cyclictest671645-21irqstats09:35:183
51958699174,4cyclictest664522-21sshd09:26:353
519586991713,3cyclictest769514-21kworker/u8:1+events_unbound12:05:183
519586991712,3cyclictest530157-21kworker/u8:3+flush-259:008:00:183
519583991714,2cyclictest586934-21kworker/u8:1+events_unbound08:25:182
519583991714,2cyclictest550530-21kworker/u8:0+events_unbound08:32:442
519583991713,3cyclictest769514-21kworker/u8:1+events_unbound12:00:122
519583991713,3cyclictest717592-21/usr/sbin/munin10:20:152
519583991713,3cyclictest670209-21store09:35:012
519583991713,3cyclictest670209-21store09:35:002
519579991714,2cyclictest481681-21kworker/u8:1+flush-259:007:10:171
519579991713,3cyclictest702031-21/usr/sbin/munin10:05:231
519579991713,3cyclictest701426-21kworker/u8:1+flush-259:010:45:001
519575991714,2cyclictest769514-21kworker/u8:1+events_unbound12:20:130
519575991714,2cyclictest550530-21kworker/u8:0+events_unbound08:45:130
519575991714,2cyclictest530157-21kworker/u8:3+events_unbound08:00:200
51958699164,4cyclictest713420-21irqstats10:15:183
51958699164,3cyclictest596866-21chrt08:20:523
51958699164,3cyclictest2109693-21snmpd12:26:523
519586991613,1cyclictest758736-21kworker/u8:0-ext4-rsv-conversion11:20:003
519586991612,3cyclictest769514-21kworker/u8:1+flush-259:012:20:223
519586991612,2cyclictest1-21systemd08:30:003
519586991610,4cyclictest754633-21ps10:55:163
519586991610,4cyclictest753948-21latency_hist10:55:003
519586991610,4cyclictest744876-21ps10:45:183
519583991613,2cyclictest628827-21kworker/u8:2+flush-259:009:50:182
519583991613,2cyclictest335557-21systemd-journal10:30:002
519583991612,3cyclictest780480-21kworker/u8:3+flush-259:011:55:202
519583991612,3cyclictest669627-21kworker/u8:0+events_unbound09:35:212
519583991612,3cyclictest550530-21kworker/u8:0+events_unbound07:42:372
519583991610,4cyclictest524964-21latency_hist07:15:002
519579991613,2cyclictest561787-21irqcore07:50:131
519579991612,3cyclictest680742-21munin-plugin-st09:45:001
519579991612,3cyclictest550530-21kworker/u8:0+flush-259:008:20:251
51957999161,13cyclictest335557-21systemd-journal09:30:001
519575991613,2cyclictest60350irq/132-enp0s29f1:rx-009:40:150
519575991612,3cyclictest832300-21kworker/u8:3+events_unbound12:26:530
51958699159,5cyclictest706980-21cron10:09:593
51958699159,4cyclictest837037-21head12:10:233
51958699159,4cyclictest821898-21turbostat.cron12:00:003
51958699159,4cyclictest811586-21idleruntime-cro11:50:003
51958699159,4cyclictest785418-21latency_hist11:25:003
51958699159,4cyclictest697121-21grep10:00:143
51958699159,4cyclictest555962-21cron07:44:593
51958699159,4cyclictest546255-21grep07:35:183
51958699158,5cyclictest728076-21cpuspeed_turbos10:30:143
51958699158,5cyclictest695827-21grep09:55:233
51958699158,5cyclictest603492-21irqcore08:30:143
51958699157,6cyclictest774712-21latency_hist11:15:003
51958699157,6cyclictest521574-21kthreadcore07:10:203
51958699156,7cyclictest790534-21latency_hist11:30:003
51958699154,2cyclictest665242-21df_inode09:30:153
51958699154,2cyclictest665242-21df_inode09:30:153
51958699154,2cyclictest634192-21df_inode09:00:133
51958699154,2cyclictest629167-21hddtemp_smartct08:55:163
519586991513,1cyclictest806436-21apt11:45:003
519586991510,3cyclictest577281-21sed08:05:173
519586991510,3cyclictest571466-21cron08:00:003
51958399159,4cyclictest780480-21kworker/u8:3+events_unbound11:50:172
51958399154,5cyclictest566299-21apt07:55:012
519583991512,1cyclictest0-21swapper/211:45:002
51957999159,4cyclictest848050-21/usr/sbin/munin12:25:141
519579991512,2cyclictest708274-21kthreadcore10:10:171
519579991511,3cyclictest550530-21kworker/u8:0+flush-259:008:45:161
51957999151,12cyclictest639000-21unin-run09:04:591
519579991510,4cyclictest821906-21latency_hist12:00:001
519575991513,1cyclictest60350irq/132-enp0s29f1:rx-011:35:060
519575991512,2cyclictest60350irq/132-enp0s29f1:rx-008:30:140
519575991511,3cyclictest481681-21kworker/u8:1+events_unbound07:30:140
51958699149,3cyclictest853346-21tr12:30:133
51958699148,4cyclictest796053-21cpuspeed_turbos11:35:153
51958699148,4cyclictest795205-21grep11:30:253
51958699148,4cyclictest707258-21apt-get10:10:113
51958699148,3cyclictest519298-21latency_hist07:10:013
51958699147,5cyclictest687435-21sed09:50:143
51958699147,5cyclictest544797-21/usr/sbin/munin07:30:233
51958699146,6cyclictest726521-21grep10:25:193
51958699146,6cyclictest525378-21df_inode07:15:123
51958699144,2cyclictest582306-21fw_forwarded_lo08:10:143
519586991410,2cyclictest538259-21kthreadcore07:25:183
51958399149,3cyclictest550530-21kworker/u8:0+flush-259:008:41:052
51958399148,4cyclictest607939-21kworker/u8:3+flush-259:008:40:002
519583991411,2cyclictest550530-21kworker/u8:0+events_unbound08:20:212
519575991410,3cyclictest758736-21kworker/u8:0+events_unbound10:56:200
51958699137,4cyclictest639319-21grep09:05:113
51958399139,3cyclictest780480-21kworker/u8:3+events_unbound11:35:262
51958399139,3cyclictest748791-21kworker/u8:2+flush-259:011:10:162
519583991310,2cyclictest481681-21kworker/u8:1+events_unbound07:15:122
51957999139,3cyclictest634674-21kworker/u8:0+flush-259:009:15:161
519579991311,1cyclictest0-21swapper/109:35:011
519579991311,1cyclictest0-21swapper/109:35:011
519579991310,2cyclictest779823-21sh11:20:001
51958399129,2cyclictest659469-21kworker/u8:1+flush-259:009:25:262
51958399128,3cyclictest550530-21kworker/u8:0+flush-259:008:45:262
51958399121,3cyclictest863733-21awk12:40:002
51957999129,2cyclictest701426-21kworker/u8:1+events_unbound10:35:201
519579991210,1cyclictest602747-21latency_hist08:30:011
519579991210,1cyclictest0-21swapper/110:55:211
51958399117,3cyclictest701426-21kworker/u8:1+events_unbound10:30:202
51957999119,1cyclictest0-21swapper/108:55:171
51957999118,2cyclictest0-21swapper/108:40:151
51957999106,3cyclictest311ktimers/107:30:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional