You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 07:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Jun 23, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2487947995552,2cyclictest2815642-21gpgv00:25:000
2487953995450,3cyclictest2487906-21kworker/u8:3+flush-259:020:00:012
2487947995044,4cyclictest2581964-21latency_hist20:40:000
2487958994841,5cyclictest2794880-21latency_hist00:05:003
2487953994541,3cyclictest2638820-21kworker/u8:0+events_unbound22:00:012
2487953994339,3cyclictest2546087-21kworker/u8:4+events_unbound21:00:222
2487958994236,4cyclictest2722216-21awk22:55:003
2487947994238,3cyclictest2670463-21apt-get22:05:130
2487953994137,3cyclictest2676013-21kworker/u8:3+flush-259:022:25:012
2487953994137,3cyclictest2669899-21kworker/u8:1+events_unbound23:20:212
2487953994134,5cyclictest335557-21systemd-journal19:35:012
2487958994034,4cyclictest2763479-21latency_hist23:35:003
2487953994036,3cyclictest2784592-21kworker/u8:2+events_unbound00:05:232
2487953994036,2cyclictest2607380-21kworker/u8:0+events_unbound21:05:222
2487953994033,2cyclictest2638820-21kworker/u8:0+events_unbound22:05:232
2487953993835,2cyclictest2669899-21kworker/u8:1+flush-259:023:25:222
2487953993835,2cyclictest2644579-21kworker/u8:1+flush-259:021:40:212
2487953993830,3cyclictest2737721-21kworker/u8:0+events_unbound23:30:232
2487950993831,5cyclictest335557-21systemd-journal20:55:001
2487947993835,2cyclictest2669899-21kworker/u8:1+flush-259:023:00:010
2487953993734,2cyclictest2592490-21kworker/u8:1+events_unbound21:15:212
2487953993733,3cyclictest2455714-21kworker/u8:2+flush-259:019:35:202
2487947993730,5cyclictest2504589-21diskstats19:25:130
2487953993632,3cyclictest2669899-21kworker/u8:1+events_unbound00:30:222
2487953993631,3cyclictest2566522-21kworker/u8:2+events_unbound21:30:002
2487958993528,5cyclictest2815712-21cp00:25:003
2487953993532,2cyclictest2638820-21kworker/u8:0+events_unbound22:15:152
2487953993532,2cyclictest2566522-21kworker/u8:2+events_unbound21:30:122
2487953993531,3cyclictest2566522-21kworker/u8:2+flush-259:020:45:002
2487950993528,5cyclictest2831453-21latency_hist00:40:011
2487958993427,5cyclictest2643495-21ntpq21:35:213
2487953993431,2cyclictest2638820-21kworker/u8:0+flush-259:021:50:192
2487953993430,3cyclictest2696659-21kworker/u8:0+events_unbound22:30:122
2487953993429,4cyclictest2455714-21kworker/u8:2+events_unbound19:10:112
2487947993427,5cyclictest2627537-21ntpq21:20:200
2487953993330,2cyclictest2784592-21kworker/u8:2+flush-259:023:55:242
2487953993330,2cyclictest2582191-21kworker/u8:3+flush-259:020:50:232
2487953993330,2cyclictest2546087-21kworker/u8:4+flush-259:020:10:152
2487953993329,3cyclictest2566522-21kworker/u8:2+events_unbound20:33:232
2487953993329,3cyclictest2540736-21kworker/u8:0+events_unbound20:25:192
2487950993327,4cyclictest2566743-21/usr/sbin/munin20:25:151
2487958993227,3cyclictest2493535-21cat19:15:003
2487953993229,2cyclictest2623938-21kworker/u8:4+events_unbound21:20:212
2487953993228,3cyclictest2768872-21kworker/u8:4+flush-259:000:25:252
2487953993228,3cyclictest2768872-21kworker/u8:4+flush-259:000:20:202
2487953993228,3cyclictest2737721-21kworker/u8:0+events_unbound23:50:212
2487950993228,3cyclictest2737721-21kworker/u8:0+flush-259:023:40:001
2487953993128,2cyclictest2487906-21kworker/u8:3+events_unbound19:45:212
2487958993026,3cyclictest2831446-21apt-get00:40:003
2487953993027,2cyclictest2669899-21kworker/u8:1+flush-259:000:15:242
2487953993026,3cyclictest2768872-21kworker/u8:4+flush-259:000:10:152
2487953993023,2cyclictest2520108-21kworker/u8:1+events_unbound20:00:172
2487950993025,3cyclictest2773812-21apt-get23:45:001
2487950993024,4cyclictest2810625-21/usr/sbin/munin00:20:131
2487950993023,5cyclictest2809505-21ntpq00:15:221
2487950993023,4cyclictest2779414-21latency_hist23:50:001
2487947993026,3cyclictest2701632-21kworker/u8:4+flush-259:022:55:010
2487958992924,4cyclictest2816089-21apt-key00:25:013
2487958992923,4cyclictest335557-21systemd-journal22:15:223
2487953992926,2cyclictest2768872-21kworker/u8:4+events_unbound00:40:002
2487953992926,2cyclictest2696659-21kworker/u8:0+events_unbound22:40:222
2487953992926,2cyclictest2487906-21kworker/u8:3+flush-259:019:15:162
2487953992925,3cyclictest2669899-21kworker/u8:1+events_unbound22:50:202
2487953992925,3cyclictest2669899-21kworker/u8:1+events_unbound22:45:182
2487953992925,3cyclictest2638820-21kworker/u8:0+events_unbound21:36:182
2487953992925,3cyclictest2566522-21kworker/u8:2+flush-259:021:46:242
2487950992923,4cyclictest335557-21systemd-journal22:35:001
2487947992924,4cyclictest335557-21systemd-journal21:41:180
2487953992825,2cyclictest2722238-21kworker/u8:2+events_unbound23:02:222
2487953992825,2cyclictest2582191-21kworker/u8:3+events_unbound20:55:152
2487953992825,2cyclictest2556442-21kworker/u8:1+events_unbound20:20:092
2487953992824,3cyclictest2737723-21kworker/u8:3+events_unbound23:10:172
2487950992823,3cyclictest2623938-21kworker/u8:4+events_unbound21:20:171
2487950992821,5cyclictest335557-21systemd-journal20:38:211
2487947992826,2cyclictest2676013-21kworker/u8:3+events_unbound22:19:560
2487958992723,3cyclictest2800324-21/usr/sbin/munin00:10:143
2487958992722,4cyclictest2707015-21apt-get22:40:113
2487958992721,4cyclictest2612959-21latency_hist21:10:013
2487953992724,2cyclictest2676013-21kworker/u8:3+events_unbound22:25:192
2487953992724,2cyclictest2638820-21kworker/u8:0+events_unbound22:10:192
2487953992724,2cyclictest2546087-21kworker/u8:4+flush-259:020:45:212
2487953992719,3cyclictest2722238-21kworker/u8:2+events_unbound22:55:202
2487950992723,3cyclictest490-21dbus-daemon20:10:011
2487950992721,4cyclictest2816057-21base6400:25:011
2487947992725,2cyclictest2676013-21kworker/u8:3+events_unbound22:14:550
2487958992621,4cyclictest509-21rs:main3
2487958992619,5cyclictest2680126-21ntpq22:10:233
2487953992624,2cyclictest2556442-21kworker/u8:1+flush-259:020:15:232
2487953992622,3cyclictest2566522-21kworker/u8:2+events_unbound21:10:182
2487953992620,4cyclictest2509524-21base6419:30:002
2487950992620,4cyclictest2566522-21kworker/u8:2+flush-259:022:15:001
2487950992619,5cyclictest2565586-21ntpq20:20:211
2487947992621,4cyclictest2768908-21apt-get23:40:120
2487947992619,5cyclictest2638788-21latency_hist21:35:000
2487953992522,2cyclictest2669899-21kworker/u8:1+events_unbound23:45:142
2487953992521,3cyclictest2696659-21kworker/u8:0+events_unbound22:38:232
2487953992521,3cyclictest2540736-21kworker/u8:0+flush-259:020:05:212
2487953992518,5cyclictest2670202-21latency_hist22:05:012
2487950992520,4cyclictest2722238-21kworker/u8:2+events_unbound23:20:151
2487950992520,3cyclictest2665323-21apt-get22:00:111
2487950992519,4cyclictest2487906-21kworker/u8:3+events_unbound20:10:011
2487947992522,2cyclictest2540736-21kworker/u8:0+events_unbound20:08:040
2487947992522,2cyclictest2455714-21kworker/u8:2+events_unbound19:55:260
2487958992421,1cyclictest2737723-21kworker/u8:3+events_unbound23:15:183
2487958992418,4cyclictest509-21rs:main3
2487958992418,4cyclictest509-21rs:main3
2487953992421,2cyclictest2784592-21kworker/u8:2+events_unbound00:00:242
2487950992420,3cyclictest2566522-21kworker/u8:2+events_unbound21:25:221
2487950992417,5cyclictest2561357-21systemd-run20:20:011
2487947992421,2cyclictest2768872-21kworker/u8:4+events_unbound00:30:460
2487947992421,2cyclictest2504396-21kworker/u8:0+events_unbound19:31:210
2487947992418,4cyclictest2530657-21/usr/sbin/munin19:50:150
2487947992418,4cyclictest2530657-21/usr/sbin/munin19:50:140
2487958992319,3cyclictest2669899-21kworker/u8:1+flush-259:000:30:253
2487958992318,4cyclictest2701831-21/usr/sbin/munin22:35:153
2487958992312,10cyclictest2695507-21ntp_kernel_err22:25:183
2487953992320,2cyclictest2487906-21kworker/u8:3+flush-259:019:20:152
2487950992320,2cyclictest2546087-21kworker/u8:4+events_unbound20:45:231
2487950992319,3cyclictest2487906-21kworker/u8:3+events_unbound19:20:201
2487950992319,3cyclictest2455714-21kworker/u8:2+flush-259:019:35:231
2487947992320,2cyclictest2701632-21kworker/u8:4+events_unbound23:04:570
2487947992320,2cyclictest2644579-21kworker/u8:1+events_unbound21:50:480
2487947992320,2cyclictest2592490-21kworker/u8:1+events_unbound20:53:520
2487947992320,2cyclictest2455714-21kworker/u8:2+events_unbound19:49:560
2487958992216,4cyclictest2525253-21latency_hist19:45:003
2487958992215,5cyclictest2487906-21kworker/u8:3+flush-259:019:20:253
2487953992219,2cyclictest2737723-21kworker/u8:3+events_unbound23:16:232
2487953992219,2cyclictest2669899-21kworker/u8:1+events_unbound23:36:222
2487953992218,3cyclictest2520108-21kworker/u8:1+events_unbound19:50:272
2487953992218,3cyclictest2520108-21kworker/u8:1+events_unbound19:50:262
2487953992216,4cyclictest2732775-21/usr/sbin/munin23:05:152
2487950992218,3cyclictest2669899-21kworker/u8:1+events_unbound22:45:161
2487950992218,2cyclictest2638820-21kworker/u8:0+events_unbound21:55:161
248795899217,3cyclictest2546095-21/usr/sbin/munin20:05:213
2487958992115,5cyclictest2763503-21kworker/u8:3+flush-259:023:35:163
2487958992115,4cyclictest335557-21systemd-journal20:27:213
2487953992117,3cyclictest2768872-21kworker/u8:4+events_unbound23:40:182
2487950992118,2cyclictest2649565-21munin-plugin-st21:45:001
2487950992116,4cyclictest2669899-21kworker/u8:1+events_unbound00:00:141
2487950992115,4cyclictest2618352-21/usr/sbin/munin21:15:151
2487950992114,5cyclictest2675368-21latency_hist22:10:011
2487950992113,6cyclictest2639045-21cat21:35:011
2487947992118,2cyclictest2737721-21kworker/u8:0+events_unbound23:46:330
2487947992118,2cyclictest2737721-21kworker/u8:0+events_unbound23:33:050
2487947992118,2cyclictest2669899-21kworker/u8:1+events_unbound23:28:390
2487947992118,2cyclictest2582191-21kworker/u8:3+events_unbound20:56:220
2487947992117,3cyclictest2540736-21kworker/u8:0+events_unbound20:16:440
2487947992115,4cyclictest335557-21systemd-journal19:39:590
2487958992014,4cyclictest2654743-21latency_hist21:50:013
2487953992015,2cyclictest2487906-21kworker/u8:3+events_unbound19:40:172
2487950992017,2cyclictest2607380-21kworker/u8:0+events_unbound21:10:251
2487950992016,3cyclictest2737721-21kworker/u8:0+flush-259:023:50:241
2487950992013,5cyclictest2639418-21cp21:35:001
2487947992017,2cyclictest2768872-21kworker/u8:4+events_unbound00:04:580
2487947992017,2cyclictest2696659-21kworker/u8:0+events_unbound22:49:560
2487947992017,2cyclictest2669899-21kworker/u8:1+events_unbound22:28:430
2487947992017,2cyclictest2669899-21kworker/u8:1+events_unbound22:24:000
2487947992017,2cyclictest2607380-21kworker/u8:0+events_unbound21:17:190
2487947992017,2cyclictest2540736-21kworker/u8:0+events_unbound20:11:060
2487947992016,3cyclictest2784592-21kworker/u8:2+events_unbound23:59:370
2487947992016,3cyclictest2737721-21kworker/u8:0+events_unbound23:52:080
2487947992015,4cyclictest335557-21systemd-journal19:43:020
248795899197,2cyclictest0-21swapper/322:05:013
2487958991916,2cyclictest2514939-21cron19:35:003
2487958991915,2cyclictest2504838-21irqcore19:25:143
2487958991913,4cyclictest335557-21systemd-journal23:41:213
2487958991913,4cyclictest2784592-21kworker/u8:2+flush-259:023:55:163
2487958991911,6cyclictest2632781-21ntpq21:25:203
2487950991915,3cyclictest2487906-21kworker/u8:3+flush-259:019:15:211
2487950991915,3cyclictest2455714-21kworker/u8:2+flush-259:019:10:191
2487950991915,3cyclictest2455714-21kworker/u8:2+events_unbound19:40:141
2487950991914,3cyclictest2566522-21kworker/u8:2+flush-259:020:32:231
2487947991917,2cyclictest2455714-21kworker/u8:2+events_unbound20:04:560
2487947991917,1cyclictest2566522-21kworker/u8:2+events_unbound20:48:510
2487947991917,1cyclictest2487906-21kworker/u8:3+events_unbound19:15:170
2487947991916,2cyclictest2768872-21kworker/u8:4+events_unbound00:12:070
2487947991916,2cyclictest2763503-21kworker/u8:3+events_unbound23:35:020
2487947991916,2cyclictest2669899-21kworker/u8:1+events_unbound22:44:010
2487947991916,2cyclictest2566522-21kworker/u8:2+events_unbound20:44:370
2487947991914,3cyclictest2493014-21apt-get19:15:000
248795899187,1cyclictest0-21swapper/320:05:003
2487958991812,4cyclictest2623938-21kworker/u8:4+flush-259:021:20:253
2487958991812,4cyclictest2556414-21/usr/sbin/munin20:15:133
2487958991812,4cyclictest2546087-21kworker/u8:4+flush-259:020:45:173
2487950991815,2cyclictest2702876-21kthreadcore22:35:181
2487950991815,2cyclictest2669899-21kworker/u8:1+events_unbound00:31:461
2487950991815,2cyclictest2582191-21kworker/u8:3+events_unbound20:55:221
2487950991814,3cyclictest509-21rs:main1
2487947991816,2cyclictest2592490-21kworker/u8:1+events_unbound21:02:330
2487947991816,2cyclictest2540736-21kworker/u8:0+events_unbound20:26:290
2487947991815,2cyclictest2831311-21kworker/u8:0+events_unbound00:38:360
2487947991815,2cyclictest2784592-21kworker/u8:2+events_unbound00:07:590
2487947991815,2cyclictest2737723-21kworker/u8:3+events_unbound23:15:380
2487947991815,2cyclictest2737723-21kworker/u8:3+events_unbound23:11:450
2487947991815,2cyclictest2722238-21kworker/u8:2+events_unbound23:23:370
2487947991815,2cyclictest2701632-21kworker/u8:4+events_unbound23:07:360
2487947991815,2cyclictest2669899-21kworker/u8:1+events_unbound22:39:390
2487947991815,2cyclictest2669899-21kworker/u8:1+events_unbound00:29:330
2487947991815,2cyclictest2566522-21kworker/u8:2+events_unbound21:29:200
2487947991814,3cyclictest2566522-21kworker/u8:2+events_unbound21:48:120
2487958991713,2cyclictest1-21systemd23:30:013
2487950991714,2cyclictest2669899-21kworker/u8:1+events_unbound23:15:221
2487950991713,3cyclictest2784592-21kworker/u8:2+events_unbound23:55:231
2487950991713,3cyclictest2737721-21kworker/u8:0+flush-259:023:30:201
2487950991712,4cyclictest2768872-21kworker/u8:4+events_unbound00:10:201
2487950991711,4cyclictest2546087-21kworker/u8:4+flush-259:020:40:151
2487947991714,2cyclictest2768872-21kworker/u8:4+events_unbound00:19:340
2487947991714,2cyclictest2638820-21kworker/u8:0+events_unbound21:35:450
2487947991714,2cyclictest2566522-21kworker/u8:2+events_unbound22:01:380
2487947991714,2cyclictest2566522-21kworker/u8:2+events_unbound20:33:090
2487947991714,2cyclictest2540736-21kworker/u8:0+events_unbound20:23:000
2487947991714,2cyclictest2493055-21kworker/u8:4+events_unbound19:24:520
248795899169,5cyclictest2649558-21latency_hist21:45:013
2487950991613,2cyclictest2737721-21kworker/u8:0+events_unbound23:30:011
2487950991612,3cyclictest2638820-21kworker/u8:0+events_unbound21:45:171
2487950991612,3cyclictest2455714-21kworker/u8:2+flush-259:019:55:161
2487950991611,4cyclictest2669899-21kworker/u8:1+events_unbound00:05:201
2487950991611,4cyclictest2504396-21kworker/u8:0+flush-259:019:25:201
2487947991613,2cyclictest2566522-21kworker/u8:2+events_unbound21:06:040
248794799160,5cyclictest2662804-21grep21:55:170
2487958991512,2cyclictest2675560-21apt-key22:10:003
2487958991511,3cyclictest2660105-21kworker/u8:4+flush-259:022:00:003
2487958991511,3cyclictest2566522-21kworker/u8:2+flush-259:020:31:513
2487958991511,2cyclictest2517498-21kthreadcore19:35:183
2487950991511,3cyclictest2669899-21kworker/u8:1+flush-259:022:50:211
2487950991511,3cyclictest2520108-21kworker/u8:1+events_unbound20:00:231
2487950991510,4cyclictest2701632-21kworker/u8:4+events_unbound23:00:251
2487947991513,1cyclictest60350irq/132-enp0s29f1:rx-021:10:270
248795899149,3cyclictest2669899-21kworker/u8:1+flush-259:023:20:263
2487958991412,1cyclictest491ktimers/320:39:453
2487958991411,2cyclictest0-21swapper/320:00:013
2487958991410,3cyclictest2669899-21kworker/u8:1+flush-259:022:50:003
248795099149,3cyclictest2737937-21/usr/sbin/munin23:10:151
248795899138,4cyclictest2676013-21kworker/u8:3+flush-259:022:20:163
248795899138,3cyclictest2774286-21gpgv23:45:003
2487958991311,1cyclictest2566515-21turbostat20:25:013
2487958991310,2cyclictest2638361-21unixbench_singl21:30:253
248795399139,3cyclictest2546087-21kworker/u8:4+events_unbound20:36:332
248795099139,3cyclictest2701632-21kworker/u8:4+flush-259:023:05:251
248795099139,3cyclictest2691330-21kworker/u8:2+events_unbound22:30:011
248795099139,3cyclictest2566522-21kworker/u8:2+flush-259:021:05:151
2487947991311,1cyclictest60350irq/132-enp0s29f1:rx-022:30:200
248795899129,2cyclictest2655222-21fschecks_time21:50:143
248795099128,3cyclictest2696659-21kworker/u8:0+events_unbound22:40:151
248795099128,3cyclictest2455714-21kworker/u8:2+flush-259:019:30:211
248795099128,2cyclictest0-21swapper/119:49:591
248795099127,3cyclictest2638820-21kworker/u8:0+events_unbound22:15:171
248795899118,2cyclictest2736733-21cut23:05:203
248795899118,2cyclictest2592588-21cpuspeed_turbos20:50:133
248795899117,2cyclictest0-21swapper/320:45:003
248795899115,4cyclictest335557-21systemd-journal21:05:013
248795899111,8cyclictest2623375-21cat21:20:003
248795899111,8cyclictest2556173-21latency_hist20:15:013
248795899111,3cyclictest2566522-21kworker/u8:2+flush-259:021:15:003
248795399119,1cyclictest0-21swapper/219:10:012
248795099117,3cyclictest2520108-21kworker/u8:1+events_unbound19:50:131
248795099117,3cyclictest2520108-21kworker/u8:1+events_unbound19:50:121
248795899106,3cyclictest2784259-21sshd23:51:233
248795099106,3cyclictest2676013-21kworker/u8:3+events_unbound22:20:241
24879589995,3cyclictest2799678-21awk00:05:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional