You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 05:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Dec 14, 2025 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2450210993630,4cyclictest2611046-21latency_hist21:45:010
2450224993328,3cyclictest2528114-21base6420:25:003
2450224993226,4cyclictest2450154-21latency_hist19:10:023
2450216993225,5cyclictest2476619-21/usr/sbin/munin19:35:161
2450216993124,4cyclictest509-21rs:main1
2450210993027,2cyclictest2512153-21kworker/u8:0+flush-259:020:15:170
2450220992924,4cyclictest3577657-21kworker/u8:3+flush-259:019:15:402
2450220992822,4cyclictest2616222-21latency_hist21:50:012
2450210992822,4cyclictest2677723-21ntpq22:45:210
2450216992722,3cyclictest2632563-21diskstats22:05:151
2450216992621,3cyclictest2788434-21apt-get00:35:131
2450216992616,8cyclictest2507524-21apt-get20:05:131
2450224992518,5cyclictest2682860-21ntpq22:50:183
2450210992520,4cyclictest2724962-21kworker/u8:1+flush-259:023:45:220
2450224992418,4cyclictest252-21systemd-journal23:02:193
2450216992420,3cyclictest2476337-21kworker/u8:2+flush-259:019:57:241
2450216992418,4cyclictest2568761-21ntpq21:00:211
2450216992418,4cyclictest2543856-21latency_hist20:40:011
2450216992417,5cyclictest2750772-21latency_hist00:00:001
2450210992419,4cyclictest2553984-21kworker/u8:1+flush-259:021:50:160
2450224992318,3cyclictest2652533-21kworker/u8:2+flush-259:023:35:183
2450220992317,4cyclictest2450440-21apt-get19:10:082
2450216992319,3cyclictest2761504-21kworker/u8:3+flush-259:000:30:261
2450216992312,9cyclictest2585427-21apt-get21:20:121
2450210992320,2cyclictest507-21in:imuxsock00:19:590
2450224992216,4cyclictest2745616-21latency_hist23:55:013
2450220992218,3cyclictest2611071-21kworker/u8:2+flush-259:021:50:222
2450220992217,4cyclictest2626580-21apt-get22:00:012
2450216992217,3cyclictest252-21systemd-journal23:27:191
2450216992217,3cyclictest2470793-21latency_hist19:30:001
2450210992218,3cyclictest2709503-21kworker/u8:1+flush-259:023:20:170
2450210992217,4cyclictest2574502-21kworker/u8:2+flush-259:021:25:260
2450210992217,3cyclictest2543897-21kworker/u8:3+flush-259:020:55:000
2450224992115,4cyclictest252-21systemd-journal21:06:203
2450224992115,4cyclictest2470958-21cat19:30:003
2450220992116,4cyclictest2569923-21/usr/sbin/munin21:05:172
2450216992114,5cyclictest2756109-21cp00:05:001
2450210992118,2cyclictest2605727-21kworker/u8:3+flush-259:022:15:160
2450224992017,2cyclictest509-21rs:main3
2450224992017,2cyclictest2621348-21kworker/u8:0+flush-259:022:24:593
2450220992014,4cyclictest509-21rs:main2
2450220992014,4cyclictest252-21systemd-journal20:15:142
2450220992013,5cyclictest2792512-21ntpq00:35:242
2450216992013,5cyclictest2730081-21latency_hist23:40:011
2450216992012,6cyclictest0-21swapper/100:30:001
2450210992015,3cyclictest2517323-21kworker/u8:1+flush-259:020:30:200
2450210992014,4cyclictest2600690-21latency_hist21:35:000
2450224991914,3cyclictest2574502-21kworker/u8:2+flush-259:021:25:173
245021699190,16cyclictest2663390-21cat22:35:001
2450210991915,3cyclictest2740223-21kworker/u8:0+events_unbound00:25:230
2450210991915,2cyclictest2652533-21kworker/u8:2+flush-259:023:45:010
2450210991914,3cyclictest2470471-21kworker/u8:1+flush-259:019:45:260
2450224991813,3cyclictest252-21systemd-journal21:05:003
2450220991815,2cyclictest2605727-21kworker/u8:3+flush-259:022:15:002
2450220991813,4cyclictest2522828-21kworker/u8:2+flush-259:020:45:192
2450220991812,4cyclictest2511525-21ntpq20:05:222
2450210991814,3cyclictest2653074-21kworker/u8:4+flush-259:022:45:000
2450210991814,3cyclictest2652533-21kworker/u8:2+flush-259:023:10:170
2450210991812,4cyclictest2642491-21latency_hist22:15:010
2450224991713,3cyclictest2595753-21/usr/sbin/munin21:30:143
2450224991713,2cyclictest2476337-21kworker/u8:2+flush-259:019:55:133
2450224991711,4cyclictest252-21systemd-journal19:15:003
2450220991715,1cyclictest0-21swapper/223:05:002
2450220991714,2cyclictest2771780-21idleruntime-cro00:20:002
245021699172,2cyclictest0-21swapper/122:19:591
2450216991712,3cyclictest2632133-21latency_hist22:05:001
245021699170,4cyclictest2554188-21idleruntime-cro20:50:001
245021699170,2cyclictest2595519-21latency_hist21:30:001
2450210991714,2cyclictest0-21swapper/000:25:000
2450210991714,1cyclictest60350irq/132-enp0s29f1:rx-021:45:170
2450210991713,3cyclictest60350irq/132-enp0s29f1:rx-019:15:340
2450224991613,2cyclictest2767330-21irqcore00:15:183
2450224991613,2cyclictest2512425-21munin-plugin-st20:10:003
2450220991610,4cyclictest2652533-21kworker/u8:2+flush-259:023:55:182
245021699166,9cyclictest2648733-21cut22:20:181
245021699166,8cyclictest0-21swapper/123:05:211
245021699163,11cyclictest513-21gdbus21:55:001
245021699161,3cyclictest2709469-21idleruntime-cro23:20:011
245021699161,2cyclictest2518856-21ps20:15:181
245021699161,2cyclictest2475492-21ntpq19:30:211
245021699161,2cyclictest2454417-21ntpq19:10:161
245021699160,5cyclictest252-21systemd-journal21:10:001
245021699160,4cyclictest2771775-21cron00:20:001
245021699160,4cyclictest2765784-21ntpq00:10:221
245021699160,3cyclictest2741031-21sort23:50:141
245021699160,3cyclictest252-21systemd-journal20:24:561
2450210991614,1cyclictest60350irq/132-enp0s29f1:rx-021:05:190
2450210991613,2cyclictest61150irq/133-enp0s29f1:tx-020:55:230
2450210991613,2cyclictest60350irq/132-enp0s29f1:rx-020:05:170
2450210991613,2cyclictest60350irq/132-enp0s29f1:rx-019:33:320
2450210991613,2cyclictest2720431-21irqcore23:30:150
2450210991613,2cyclictest2470471-21kworker/u8:1+flush-259:019:40:230
2450210991612,3cyclictest60350irq/132-enp0s29f1:rx-020:00:200
2450210991612,3cyclictest2621348-21kworker/u8:0+flush-259:022:20:260
2450210991612,2cyclictest61150irq/133-enp0s29f1:tx-020:10:230
2450210991612,2cyclictest2502119-21idleruntime-cro20:00:000
2450210991610,5cyclictest2528642-21apt-get20:25:100
2450224991513,1cyclictest0-21swapper/300:10:003
2450224991512,2cyclictest2560023-21irqcore20:55:173
2450224991511,2cyclictest2476337-21kworker/u8:2+flush-259:019:40:173
2450224991510,3cyclictest2518259-21grep20:15:173
245022099159,4cyclictest252-21systemd-journal19:40:002
2450220991512,2cyclictest0-21swapper/223:10:012
245021699152,4cyclictest2487397-21sed19:45:171
245021699152,2cyclictest2735509-21apt-get23:45:131
245021699152,2cyclictest2709740-21apt-get23:20:121
245021699152,2cyclictest2652831-21cron22:25:011
245021699151,5cyclictest2719994-21/usr/sbin/munin23:30:171
245021699151,5cyclictest2599766-21ntpq21:30:191
245021699151,4cyclictest2544526-21sed20:40:151
245021699151,3cyclictest2461191-21irqcore19:20:161
245021699151,2cyclictest2734277-21grep23:40:201
245021699151,2cyclictest2689173-21apt-get23:00:131
245021699151,2cyclictest252-21systemd-journal22:15:001
245021699151,2cyclictest2516641-21ntpq20:10:191
245021699151,1cyclictest2533852-21apt-get20:30:151
245021699151,1cyclictest2459611-21ntpq19:15:351
245021699150,4cyclictest2683772-21cron22:55:001
245021699150,3cyclictest2761457-21cron00:09:591
245021699150,3cyclictest2688925-21awk23:00:001
245021699150,3cyclictest2668986-21tr22:40:201
245021699150,3cyclictest2621922-21perl21:55:131
245021699150,3cyclictest2616337-21latency_hist21:50:011
245021699150,3cyclictest2581223-21sed21:15:181
245021699150,3cyclictest2554770-21idleruntime20:50:171
245021699150,2cyclictest2674133-21grep22:45:151
245021699150,2cyclictest2575460-21if_enp0s30f421:10:151
245021699150,2cyclictest24920642chrt19:50:131
245021699150,1cyclictest2777375-21latency_hist00:25:001
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-023:55:250
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-023:05:270
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-022:35:200
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-022:05:260
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-022:03:550
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-021:20:170
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-021:15:480
2450210991513,1cyclictest60350irq/132-enp0s29f1:rx-020:20:460
2450210991512,2cyclictest60350irq/132-enp0s29f1:rx-022:28:280
2450210991512,2cyclictest60350irq/132-enp0s29f1:rx-020:46:460
245022499149,4cyclictest2688910-21latency_hist23:00:013
2450224991411,2cyclictest2748183-21kthreadcore23:55:183
2450224991411,2cyclictest2735933-21irqcore23:45:173
2450224991411,2cyclictest2563700-21kworker/u8:0+flush-259:021:20:003
2450224991410,3cyclictest2621348-21kworker/u8:0+flush-259:022:05:183
2450224991410,3cyclictest2522828-21kworker/u8:2+flush-259:020:45:213
2450224991410,3cyclictest252-21systemd-journal23:17:203
245022099142,10cyclictest2678610-21idleruntime-cro22:49:592
2450220991411,2cyclictest0-21swapper/222:00:012
2450220991411,1cyclictest2704356-21basename23:15:002
2450220991410,3cyclictest2652533-21kworker/u8:2+flush-259:023:15:232
2450220991410,3cyclictest2491813-21kworker/u8:0+flush-259:019:55:252
245021699145,7cyclictest0-21swapper/120:00:131
245021699142,2cyclictest2528642-21apt-get20:25:101
245021699141,2cyclictest2604966-21ntpq21:35:201
245021699140,4cyclictest2559708-21grep20:55:131
245021699140,3cyclictest2699614-21tr23:10:141
2450210991413,1cyclictest60350irq/132-enp0s29f1:rx-019:36:510
2450210991412,1cyclictest60350irq/132-enp0s29f1:rx-023:50:180
2450210991412,1cyclictest60350irq/132-enp0s29f1:rx-023:25:180
2450210991412,1cyclictest60350irq/132-enp0s29f1:rx-022:50:240
2450210991412,1cyclictest60350irq/132-enp0s29f1:rx-022:30:150
2450210991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:160
2450210991412,1cyclictest60350irq/132-enp0s29f1:rx-021:13:220
2450210991412,1cyclictest60350irq/132-enp0s29f1:rx-000:35:270
2450210991411,2cyclictest60350irq/132-enp0s29f1:rx-022:55:160
2450210991411,2cyclictest60350irq/132-enp0s29f1:rx-020:35:160
2450210991411,2cyclictest60350irq/132-enp0s29f1:rx-000:10:160
2450210991411,2cyclictest60350irq/132-enp0s29f1:rx-000:07:090
2450210991410,2cyclictest2740223-21kworker/u8:0+flush-259:000:30:190
245022499138,4cyclictest2777375-21latency_hist00:25:003
245022499138,4cyclictest2653074-21kworker/u8:4+flush-259:022:40:203
245022499136,5cyclictest2475500-21ntpq19:30:213
2450224991311,1cyclictest0-21swapper/322:35:003
2450224991310,2cyclictest2626591-21cut22:00:003
2450224991310,2cyclictest2618792-21kthreadcore21:50:183
2450224991310,2cyclictest2487366-21irqcore19:45:183
245022099139,3cyclictest2724962-21kworker/u8:1+events_unbound23:45:182
245022099139,2cyclictest2598079-21kthreadcore21:30:182
245022099137,4cyclictest252-21systemd-journal22:59:212
245022099137,1cyclictest0-21swapper/222:55:002
2450220991310,2cyclictest2782823-21latency_hist00:30:002
2450220991310,2cyclictest2487355-21grep19:45:172
2450220991310,2cyclictest2464769-21ntp_kernel_pll_19:20:212
2450220991310,2cyclictest0-21swapper/220:25:002
245021699130,1cyclictest0-21swapper/119:10:011
245021099139,3cyclictest60350irq/132-enp0s29f1:rx-019:25:130
245021099137,4cyclictest2544090-21/usr/sbin/munin20:40:130
2450210991312,1cyclictest60350irq/132-enp0s29f1:rx-023:02:100
2450210991311,1cyclictest60350irq/132-enp0s29f1:rx-023:15:230
2450210991311,1cyclictest60350irq/132-enp0s29f1:rx-019:10:540
2450210991311,1cyclictest60350irq/132-enp0s29f1:rx-000:02:540
245022499129,2cyclictest507-21in:imuxsock00:35:003
245022499129,2cyclictest2788501-21cpuspeed_turbos00:35:143
245022499129,2cyclictest2734755-21unixbench_multi23:40:243
245022499129,2cyclictest2653175-21cpuspeed_turbos22:25:133
245022499129,2cyclictest2642823-21cpuspeed_turbos22:15:143
245022499129,2cyclictest2506329-21ntp_kernel_err20:00:213
245022499128,2cyclictest0-21swapper/320:35:163
245022499127,4cyclictest2528470-21base6420:25:013
245022099129,2cyclictest2715305-21irqcore23:25:172
245022099129,2cyclictest2568184-21kthreadcore21:00:182
245022099128,3cyclictest2776953-21unixbench_singl00:20:242
245022099128,3cyclictest2605727-21kworker/u8:3+flush-259:022:15:252
2450210991211,1cyclictest60350irq/132-enp0s29f1:rx-023:37:010
2450210991211,1cyclictest60350irq/132-enp0s29f1:rx-021:56:440
2450210991210,1cyclictest60350irq/132-enp0s29f1:rx-019:20:160
245022499118,2cyclictest2718844-21ntp_kernel_err23:25:223
245022499111,9cyclictest2512706-21sshd20:10:123
245022499110,1cyclictest24658272cat19:25:003
245022099118,2cyclictest2724488-21unixbench_singl23:30:242
245022099118,2cyclictest2554585-21cpuspeed_turbos20:50:152
245022099118,2cyclictest0-21swapper/223:20:192
245022099117,3cyclictest2788134-21cron00:35:002
245022099117,3cyclictest2668574-21apt-get22:40:152
245022099117,2cyclictest0-21swapper/219:30:002
245022099115,5cyclictest252-21systemd-journal23:55:012
245021099119,1cyclictest60350irq/132-enp0s29f1:rx-019:50:300
245022099108,1cyclictest0-21swapper/221:25:252
245022099108,1cyclictest0-21swapper/221:15:152
245022099108,1cyclictest0-21swapper/220:55:182
245022099107,1cyclictest0-21swapper/223:40:002
245022099106,3cyclictest2755514-21unixbench_singl00:00:242
245022099106,2cyclictest252-21systemd-journal19:54:552
245022099106,2cyclictest0-21swapper/221:20:182
245022099106,2cyclictest0-21swapper/200:10:262
245022099105,3cyclictest2471384-21base6419:30:012
245022099104,4cyclictest2606135-21apt-get21:40:122
245022099100,8cyclictest2605867-21latency_hist21:40:002
245022099100,8cyclictest2533796-21cat20:30:012
245022099100,8cyclictest252-21systemd-journal20:40:012
245022099100,3cyclictest2730081-21latency_hist23:40:012
24502249997,1cyclictest0-21swapper/321:45:143
24502249996,1cyclictest0-21swapper/300:14:593
24502209997,1cyclictest0-21swapper/222:25:202
24502209996,2cyclictest2648037-21cpuspeed_turbos22:20:142
24502209996,1cyclictest0-21swapper/220:15:012
24502209991,6cyclictest2503189-21cut20:00:162
24502249984,3cyclictest2667381-21sed22:35:203
24502209985,1cyclictest0-21swapper/220:30:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional