You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 12:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed Jun 10, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2702827994135,4cyclictest2995509-21latency_hist23:50:010
2702837993933,4cyclictest2917365-21latency_hist22:35:013
2702827993933,4cyclictest335557-21systemd-journal21:31:480
2702827993933,4cyclictest3016347-21gpgv00:10:000
2702834993630,4cyclictest2874789-21ntpq21:50:192
2702827993633,2cyclictest3000658-21kworker/u8:0+events_unbound00:25:010
2702827993629,5cyclictest2885052-21ntpq22:00:190
2702834993531,3cyclictest2860233-21kworker/u8:0+flush-259:022:10:002
2702837993427,5cyclictest335557-21systemd-journal00:00:003
2702834993428,4cyclictest2786745-21latency_hist20:30:002
2702827993224,7cyclictest2823539-21kworker/u8:3+flush-259:022:00:010
2702837993125,4cyclictest2979689-21base6423:35:013
2702832993025,4cyclictest2963947-21/usr/sbin/munin23:20:211
2702832992926,2cyclictest2968891-21kworker/u8:3+events_unbound23:40:231
2702832992925,3cyclictest2771042-21kworker/u8:4+events_unbound20:15:121
2702827992926,2cyclictest2823539-21kworker/u8:3+events_unbound21:40:000
2702834992822,4cyclictest2911903-21journal-offline22:26:462
2702832992824,3cyclictest2907228-21kworker/u8:2+flush-259:022:25:241
2702832992824,3cyclictest2643960-21kworker/u8:2+events_unbound19:14:301
2702832992822,3cyclictest2802864-21/usr/sbin/munin20:45:141
2702832992722,4cyclictest2717825-21ntpq19:20:211
2702827992723,3cyclictest2707842-21kworker/u8:3+flush-259:019:35:220
2702827992720,5cyclictest2978269-21ntpq23:30:200
2702832992623,2cyclictest301rcuc/121:30:001
2702832992623,2cyclictest2828584-21gpgv21:10:001
2702832992622,3cyclictest2963330-21kworker/u8:2+events_unbound23:49:341
2702832992622,3cyclictest2855309-21/usr/sbin/munin21:35:231
2702837992519,4cyclictest2702765-21latency_hist19:10:013
2702834992519,4cyclictest2870511-21latency_hist21:50:012
2702832992522,2cyclictest2750187-21kworker/u8:1+flush-259:020:05:171
2702832992521,3cyclictest2740126-21apt-get19:45:111
2702832992520,4cyclictest335557-21systemd-journal20:05:001
2702832992518,5cyclictest3031530-21ntpq00:20:201
2702827992421,2cyclictest2760500-21kworker/u8:2+flush-259:020:40:170
2702827992420,3cyclictest2771042-21kworker/u8:4+flush-259:020:20:250
2702834992318,4cyclictest2834045-21apt-get21:15:002
2702834992318,3cyclictest2979415-21store23:35:012
2702832992321,2cyclictest2771042-21kworker/u8:4+flush-259:020:30:301
2702832992320,2cyclictest2818157-21kworker/u8:2+flush-259:021:41:391
2702827992320,2cyclictest2907228-21kworker/u8:2+flush-259:022:25:240
2702827992320,2cyclictest2860233-21kworker/u8:0+events_unbound23:20:230
2702837992216,4cyclictest335557-21systemd-journal21:16:483
2702834992216,4cyclictest2796600-21ntpq20:35:222
2702832992219,2cyclictest3000658-21kworker/u8:0+events_unbound00:10:141
2702832992219,2cyclictest2860233-21kworker/u8:0+flush-259:022:30:201
2702832992219,2cyclictest2860233-21kworker/u8:0+flush-259:022:15:211
2702832992218,3cyclictest2968891-21kworker/u8:3+events_unbound00:07:081
2702832992218,3cyclictest2760500-21kworker/u8:2+flush-259:020:25:301
2702832992218,3cyclictest2723949-21kworker/u8:2+flush-259:019:36:291
2702832992217,4cyclictest3000658-21kworker/u8:0+flush-259:000:15:141
2702832992216,4cyclictest2833124-21ntpq21:10:191
2702827992219,2cyclictest2786767-21kworker/u8:1+flush-259:021:00:220
2702827992219,2cyclictest2697623-21kworker/u8:0+events_unbound19:12:300
2702827992218,3cyclictest2823539-21kworker/u8:3+flush-259:021:30:010
2702827992218,3cyclictest2823539-21kworker/u8:3+events_unbound22:05:250
2702837992117,3cyclictest2906599-21gpgv22:24:593
2702837992116,3cyclictest335557-21systemd-journal22:45:013
2702837992114,5cyclictest2989900-21latency_hist23:45:013
2702834992116,3cyclictest2707842-21kworker/u8:3+flush-259:019:50:152
2702832992118,3cyclictest2932778-21kworker/u8:1+events_unbound22:55:191
2702832992118,2cyclictest2932778-21kworker/u8:1+flush-259:023:15:261
2702832992118,2cyclictest2707842-21kworker/u8:3+flush-259:019:50:221
2702827992118,2cyclictest2860233-21kworker/u8:0+events_unbound22:31:530
2702827992117,3cyclictest2948506-21apt-get23:05:120
2702827992117,3cyclictest2932778-21kworker/u8:1+events_unbound22:55:160
2702827992117,3cyclictest2860474-21apt-get21:40:120
2702827992117,3cyclictest2818157-21kworker/u8:2+events_unbound21:15:210
2702827992117,3cyclictest2707842-21kworker/u8:3+events_unbound19:30:140
270283799204,5cyclictest2728330-21taskset19:30:233
270283799204,4cyclictest2869649-21ntpq21:45:223
270283799203,6cyclictest2885129-21ntpq22:00:223
2702837992016,3cyclictest2963330-21kworker/u8:2+flush-259:023:20:023
270283499201,7cyclictest3037545-21munin-run00:30:012
2702834992013,5cyclictest335557-21systemd-journal22:55:002
2702834992013,4cyclictest3001068-21diskstats23:55:142
2702832992018,1cyclictest0-21swapper/122:15:011
2702832992017,2cyclictest2896501-21kworker/u8:4+events_unbound22:20:181
2702832992017,2cyclictest2860233-21kworker/u8:0+events_unbound23:25:221
2702832992017,2cyclictest2818157-21kworker/u8:2+flush-259:021:50:011
2702832992017,2cyclictest2760500-21kworker/u8:2+events_unbound20:36:291
2702832992017,2cyclictest2750187-21kworker/u8:1+events_unbound20:10:131
2702827992017,2cyclictest2968891-21kworker/u8:3+flush-259:000:30:160
2702827992016,3cyclictest2786767-21kworker/u8:1+flush-259:020:45:220
2702827992016,3cyclictest2786767-21kworker/u8:1+events_unbound20:55:210
2702827992014,4cyclictest2739868-21latency_hist19:45:010
2702827992014,4cyclictest2713135-21apt-get19:20:010
270283799193,5cyclictest2995447-21sshd23:49:323
2702837991913,4cyclictest2786767-21kworker/u8:1+flush-259:020:55:173
2702834991915,3cyclictest3047928-21sh00:39:592
2702834991914,4cyclictest2932778-21kworker/u8:1+flush-259:023:00:212
2702834991913,4cyclictest2860233-21kworker/u8:0+flush-259:022:20:252
2702834991913,4cyclictest2818157-21kworker/u8:2+flush-259:021:20:172
2702834991912,4cyclictest3020751-21ntpq00:10:212
2702832991916,2cyclictest2739882-21kworker/u8:0+events_unbound19:55:201
2702832991915,3cyclictest2963330-21kworker/u8:2+flush-259:023:35:221
2702832991915,3cyclictest2907228-21kworker/u8:2+events_unbound22:41:501
2702827991916,2cyclictest335557-21systemd-journal00:14:560
2702827991916,2cyclictest2968891-21kworker/u8:3+flush-259:000:35:160
2702827991916,2cyclictest2907228-21kworker/u8:2+events_unbound22:46:530
2702827991916,2cyclictest2797094-21kworker/u8:0+flush-259:020:50:200
2702827991916,2cyclictest2755370-21latency_hist20:00:000
2702827991915,3cyclictest2963330-21kworker/u8:2+events_unbound23:50:180
2702827991915,3cyclictest2958830-21apt-get23:15:130
2702827991915,3cyclictest2860233-21kworker/u8:0+events_unbound22:20:280
270283799186,4cyclictest2737249-21kthreadcore19:40:183
270283799185,8cyclictest2942166-21ntpq22:55:223
2702837991815,2cyclictest2776416-21latency_hist20:20:003
2702837991812,4cyclictest2776649-21cp20:20:003
2702834991814,3cyclictest2891133-21kworker/u8:2+flush-259:022:15:012
2702834991814,3cyclictest2787009-21apt-get20:30:122
2702834991814,3cyclictest2786767-21kworker/u8:1+flush-259:020:52:362
2702834991813,3cyclictest2818119-21cron21:00:002
2702834991812,4cyclictest2952483-21ntpq23:05:212
2702832991816,2cyclictest2723949-21kworker/u8:2+flush-259:019:30:241
2702832991815,2cyclictest2968891-21kworker/u8:3+events_unbound00:30:201
2702832991815,2cyclictest2963330-21kworker/u8:2+events_unbound23:55:151
2702832991815,2cyclictest2860233-21kworker/u8:0+flush-259:023:05:251
2702832991815,2cyclictest2823539-21kworker/u8:3+flush-259:021:56:511
2702832991814,3cyclictest2823539-21kworker/u8:3+events_unbound22:05:281
2702827991815,2cyclictest2818157-21kworker/u8:2+flush-259:021:05:250
2702827991814,3cyclictest2860233-21kworker/u8:0+events_unbound22:10:210
2702827991814,3cyclictest2707842-21kworker/u8:3+events_unbound19:45:200
2702827991814,3cyclictest2697623-21kworker/u8:0+events_unbound19:26:290
270283799174,3cyclictest2802328-21modprobe20:41:313
2702837991714,2cyclictest509-21rs:main3
2702837991713,3cyclictest0-21swapper/321:10:013
2702837991712,3cyclictest335557-21systemd-journal20:33:303
2702834991713,3cyclictest2860233-21kworker/u8:0+flush-259:023:24:022
2702834991711,4cyclictest2953645-21apt-get23:10:122
2702832991714,3cyclictest2912205-21kworker/u8:3+events_unbound22:35:191
2702832991714,2cyclictest2943105-21kworker/u8:3+events_unbound23:10:251
2702832991714,2cyclictest2786767-21kworker/u8:1+flush-259:020:55:301
2702832991714,2cyclictest2707842-21kworker/u8:3+events_unbound19:41:441
2702827991715,1cyclictest2844779-21cron21:25:000
2702827991714,2cyclictest2968891-21kworker/u8:3+flush-259:023:40:210
2702827991714,2cyclictest2932778-21kworker/u8:1+events_unbound23:00:230
2702827991714,2cyclictest2860233-21kworker/u8:0+events_unbound23:25:130
2702827991714,2cyclictest2823539-21kworker/u8:3+flush-259:021:50:160
2702827991713,3cyclictest2912205-21kworker/u8:3+events_unbound22:36:320
2702827991713,3cyclictest2823539-21kworker/u8:3+events_unbound21:10:220
270283799169,5cyclictest2760842-21cut20:05:113
270283799163,4cyclictest2890781-21chrt22:06:123
270283799163,3cyclictest2786433-21sshd20:26:263
2702837991612,3cyclictest2707842-21kworker/u8:3+flush-259:019:35:183
2702837991610,4cyclictest3016113-21apt-get00:10:013
2702837991610,4cyclictest2948241-21latency_hist23:05:003
2702834991612,2cyclictest2860233-21kworker/u8:0+flush-259:023:25:232
2702834991612,2cyclictest2697623-21kworker/u8:0+flush-259:019:20:172
2702834991611,4cyclictest2818157-21kworker/u8:2+flush-259:021:15:112
2702834991611,3cyclictest2860233-21kworker/u8:0+flush-259:022:00:322
2702834991610,4cyclictest2703013-21/usr/sbin/munin19:10:202
2702832991613,2cyclictest2963330-21kworker/u8:2+events_unbound23:50:231
2702832991613,2cyclictest2932778-21kworker/u8:1+events_unbound23:00:181
2702832991613,2cyclictest2907228-21kworker/u8:2+flush-259:022:53:031
2702832991613,2cyclictest2818157-21kworker/u8:2+flush-259:021:20:201
2702832991613,2cyclictest2786767-21kworker/u8:1+flush-259:021:00:171
2702832991611,4cyclictest2931898-21ntpq22:45:211
2702827991614,1cyclictest60350irq/132-enp0s29f1:rx-020:07:520
2702827991614,1cyclictest60350irq/132-enp0s29f1:rx-000:15:310
2702827991613,2cyclictest60350irq/132-enp0s29f1:rx-020:15:130
2702827991613,2cyclictest2968891-21kworker/u8:3+events_unbound00:27:360
2702827991612,3cyclictest2792484-21gpgv20:35:000
270283799156,6cyclictest2912383-21sed22:30:013
270283799155,7cyclictest2963827-21latency_hist23:20:003
270283799152,3cyclictest2765919-21/usr/sbin/munin20:10:203
2702837991512,2cyclictest3032665-21apt-get00:25:123
2702837991512,2cyclictest0-21swapper/300:05:013
270283499159,4cyclictest2765919-21/usr/sbin/munin20:10:152
2702834991511,3cyclictest2723949-21kworker/u8:2+flush-259:019:36:192
2702834991511,2cyclictest2755377-21basename20:00:012
2702832991512,3cyclictest2823539-21kworker/u8:3+events_unbound21:33:321
2702832991512,2cyclictest2968891-21kworker/u8:3+flush-259:000:00:211
2702832991512,2cyclictest2823539-21kworker/u8:3+flush-259:021:50:151
2702832991512,2cyclictest2823539-21kworker/u8:3+flush-259:021:17:021
2702832991512,2cyclictest2643960-21kworker/u8:2+events_unbound19:16:421
2702832991511,3cyclictest3000658-21kworker/u8:0+flush-259:000:35:331
2702832991511,3cyclictest2760500-21kworker/u8:2+events_unbound20:40:161
2702827991513,1cyclictest60350irq/132-enp0s29f1:rx-023:55:220
2702827991513,1cyclictest60350irq/132-enp0s29f1:rx-021:45:150
2702827991513,1cyclictest60350irq/132-enp0s29f1:rx-019:54:300
2702827991512,2cyclictest2860233-21kworker/u8:0+flush-259:022:15:180
2702827991511,3cyclictest60350irq/132-enp0s29f1:rx-019:15:120
270283799148,4cyclictest2937945-21idleruntime-cro22:54:593
270283799147,5cyclictest335557-21systemd-journal20:00:013
270283799143,3cyclictest2740100-21/usr/sbin/munin19:45:153
270283799143,2cyclictest2796423-21memory20:35:193
270283799142,3cyclictest3027787-21fw_conntrack00:20:143
2702837991411,2cyclictest2891472-21cpuspeed_turbos22:10:123
2702837991410,2cyclictest0-21swapper/321:40:013
270283499149,4cyclictest3000658-21kworker/u8:0+flush-259:000:00:112
2702834991412,1cyclictest0-21swapper/219:35:002
270283499141,11cyclictest2781607-21awk20:24:592
2702834991410,3cyclictest2823294-21cron21:05:002
2702832991412,2cyclictest2823539-21kworker/u8:3+flush-259:022:00:231
2702832991412,2cyclictest2760500-21kworker/u8:2+events_unbound20:20:271
2702832991411,2cyclictest2719732-21irqcore19:25:151
2702827991412,2cyclictest2707842-21kworker/u8:3+flush-259:020:00:160
2702827991412,1cyclictest60350irq/132-enp0s29f1:rx-020:30:170
2702827991412,1cyclictest60350irq/132-enp0s29f1:rx-000:00:060
2702827991411,2cyclictest60350irq/132-enp0s29f1:rx-023:10:170
2702827991411,2cyclictest60350irq/132-enp0s29f1:rx-020:25:110
2702827991411,2cyclictest2907228-21kworker/u8:2+events_unbound22:40:210
270283799139,2cyclictest2708038-21cat19:15:013
270283799138,3cyclictest2999733-21ntpq23:50:213
270283799137,4cyclictest2977158-21cut23:30:173
270283799137,4cyclictest2719119-21tr19:25:113
270283799136,5cyclictest2840036-21expr21:20:133
270283799136,4cyclictest2850351-21tr21:30:133
270283799135,6cyclictest3027301-21latency_hist00:20:013
270283799135,6cyclictest2971015-21grep23:25:183
270283799135,6cyclictest2715570-21tr19:20:183
270283799133,2cyclictest2870928-21df_inode21:50:123
270283799132,2cyclictest2954625-21irqstats23:10:173
2702837991310,1cyclictest2849115-21ntpq21:25:213
270283499139,3cyclictest3016357-21latency_hist00:10:012
270283499139,3cyclictest2750187-21kworker/u8:1+flush-259:020:15:192
270283499139,3cyclictest2697623-21kworker/u8:0+flush-259:019:25:162
270283499139,2cyclictest0-21swapper/220:40:222
270283499138,4cyclictest2860233-21kworker/u8:0+flush-259:021:55:362
2702834991310,2cyclictest3032410-21sh00:25:012
2702832991310,2cyclictest2968891-21kworker/u8:3+events_unbound00:29:581
2702827991311,1cyclictest60350irq/132-enp0s29f1:rx-020:14:110
2702827991310,2cyclictest2907228-21kworker/u8:2+flush-259:022:51:020
270283799126,5cyclictest2928328-21grep22:45:173
270283799125,5cyclictest2950957-21kthreadcore23:05:193
270283799125,5cyclictest2861171-21sed21:40:163
270283799125,5cyclictest2806329-21grep20:45:173
270283499129,2cyclictest2739384-21unixbench_multi19:40:252
270283499129,1cyclictest0-21swapper/222:35:122
270283499128,3cyclictest2739882-21kworker/u8:0+flush-259:020:07:332
270283499128,2cyclictest0-21swapper/222:40:172
270283499127,3cyclictest335557-21systemd-journal23:45:032
270283499125,5cyclictest2855070-21latency_hist21:35:012
270283299129,2cyclictest2797094-21kworker/u8:0+flush-259:020:50:261
270283799115,4cyclictest2897548-21kthreadcore22:15:173
270283499117,2cyclictest2713132-21latency_hist19:20:012
270283499107,1cyclictest0-21swapper/221:25:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional