You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 04:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun May 31, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10413994844,3cyclictest5204-21kworker/u8:4+flush-259:019:20:001
10421994744,2cyclictest87766-21kworker/u8:1+events_unbound20:35:253
10421994440,3cyclictest4361-21kworker/u8:0+events_unbound19:45:203
10416994439,2cyclictest15528-21kworker/u8:1+events_unbound19:35:202
10413994340,2cyclictest134959-21kworker/u8:0+flush-259:021:15:211
10411994337,4cyclictest212761-21latency_hist22:25:000
10421994239,2cyclictest87766-21kworker/u8:1+events_unbound22:25:193
10421994239,2cyclictest315905-21kworker/u8:4+flush-259:000:10:163
10421994237,4cyclictest10330-21latency_hist19:10:003
10413994238,3cyclictest4361-21kworker/u8:0+flush-259:019:35:241
10421994138,2cyclictest4361-21kworker/u8:0+events_unbound20:15:223
10421994138,2cyclictest15528-21kworker/u8:1+events_unbound19:35:173
10411994034,4cyclictest4361-21kworker/u8:0+flush-259:019:45:170
10421993936,2cyclictest87766-21kworker/u8:1+events_unbound23:20:243
10421993936,2cyclictest87766-21kworker/u8:1+events_unbound23:10:003
10413993835,2cyclictest295683-21kworker/u8:2+events_unbound23:45:231
10413993834,3cyclictest87766-21kworker/u8:1+flush-259:021:30:011
10421993734,2cyclictest87766-21kworker/u8:1+events_unbound21:20:243
10421993734,2cyclictest4361-21kworker/u8:0+events_unbound20:20:243
10421993734,2cyclictest212782-21kworker/u8:0+events_unbound23:32:333
10413993733,3cyclictest118871-21gpgv20:54:591
10411993731,4cyclictest165595-21kworker/u8:0+flush-259:021:45:170
10411993730,5cyclictest279815-21latency_hist23:30:000
10421993633,2cyclictest165595-21kworker/u8:0+events_unbound22:00:233
10411993631,3cyclictest202770-21apt-get22:15:120
10421993532,2cyclictest87766-21kworker/u8:1+flush-259:023:15:203
10421993532,2cyclictest191740-21kworker/u8:3+events_unbound22:15:243
10421993532,2cyclictest145024-21kworker/u8:3+events_unbound21:34:333
10421993531,3cyclictest165595-21kworker/u8:0+events_unbound21:55:113
10416993531,3cyclictest295683-21kworker/u8:2+flush-259:000:05:182
10421993431,2cyclictest337971-21kworker/u8:3+events_unbound00:29:193
10421993431,2cyclictest295683-21kworker/u8:2+events_unbound00:15:243
10413993430,3cyclictest61867-21gpgv20:00:001
10421993331,2cyclictest134959-21kworker/u8:0+events_unbound21:10:143
10421993330,2cyclictest41283-21kworker/u8:2+events_unbound19:50:153
10421993330,2cyclictest15528-21kworker/u8:1+events_unbound19:20:223
10416993329,3cyclictest4361-21kworker/u8:0+events_unbound20:10:232
10416993327,4cyclictest335557-21systemd-journal19:26:332
10413993329,3cyclictest72770-21kworker/u8:3+events_unbound20:45:271
10411993329,3cyclictest243997-21apt-get22:55:120
10421993230,2cyclictest326604-21kworker/u8:0+events_unbound00:38:023
10421993229,2cyclictest72770-21kworker/u8:3+events_unbound20:45:343
10421993229,2cyclictest4361-21kworker/u8:0+events_unbound19:25:243
10421993229,2cyclictest315905-21kworker/u8:4+events_unbound00:30:023
10421993228,3cyclictest87766-21kworker/u8:1+events_unbound20:51:323
10416993229,2cyclictest87766-21kworker/u8:1+events_unbound23:15:252
10416993229,2cyclictest87766-21kworker/u8:1+events_unbound20:50:182
10416993229,2cyclictest41283-21kworker/u8:2+flush-259:020:05:212
10416993229,2cyclictest249124-21kworker/u8:3+flush-259:023:05:232
10416993228,3cyclictest212782-21kworker/u8:0+events_unbound22:28:322
10413993229,2cyclictest4361-21kworker/u8:0+events_unbound19:30:171
10413993229,2cyclictest41283-21kworker/u8:2+events_unbound20:05:221
10413993228,3cyclictest145024-21kworker/u8:3+flush-259:021:35:191
10411993228,2cyclictest264642-21apt-get23:15:120
10421993129,2cyclictest5204-21kworker/u8:4+events_unbound19:32:273
10421993128,3cyclictest145024-21kworker/u8:3+events_unbound21:25:353
10421993128,2cyclictest72770-21kworker/u8:3+events_unbound20:42:343
10421993128,2cyclictest191740-21kworker/u8:3+flush-259:022:05:323
10421993127,3cyclictest87766-21kworker/u8:1+events_unbound22:39:343
10416993129,2cyclictest165595-21kworker/u8:0+events_unbound21:45:242
10416993128,2cyclictest87766-21kworker/u8:1+flush-259:023:20:202
10416993127,3cyclictest212783-21kworker/u8:2+flush-259:022:25:002
10413993128,2cyclictest295683-21kworker/u8:2+events_unbound00:15:211
10421993027,2cyclictest87766-21kworker/u8:1+events_unbound21:15:183
10416993027,2cyclictest212782-21kworker/u8:0+flush-259:023:35:152
10416993026,3cyclictest87766-21kworker/u8:1+flush-259:022:10:222
10416993026,3cyclictest87766-21kworker/u8:1+flush-259:021:20:262
10413993027,2cyclictest72770-21kworker/u8:3+events_unbound20:11:321
10413993026,3cyclictest87766-21kworker/u8:1+events_unbound20:35:291
10421992926,3cyclictest87766-21kworker/u8:1+events_unbound21:05:273
10421992926,2cyclictest4361-21kworker/u8:0+events_unbound19:15:233
10421992925,3cyclictest311175-21kworker/u8:1+flush-259:000:00:163
10416992925,3cyclictest87766-21kworker/u8:1+events_unbound20:38:342
10416992925,3cyclictest4361-21kworker/u8:0+events_unbound19:42:282
10416992925,3cyclictest285591-21kworker/u8:3+events_unbound23:50:172
10416992925,3cyclictest212783-21kworker/u8:2+events_unbound22:40:002
10413992926,2cyclictest285591-21kworker/u8:3+events_unbound23:55:261
10413992926,2cyclictest15528-21kworker/u8:1+flush-259:019:50:211
10411992920,6cyclictest335557-21systemd-journal00:25:010
10421992826,2cyclictest285591-21kworker/u8:3+events_unbound23:52:563
10421992826,2cyclictest212782-21kworker/u8:0+events_unbound23:01:343
10421992825,3cyclictest165595-21kworker/u8:0+events_unbound21:50:233
10421992825,2cyclictest212782-21kworker/u8:0+events_unbound22:30:193
10421992824,3cyclictest41283-21kworker/u8:2+events_unbound19:55:343
10416992825,2cyclictest295683-21kworker/u8:2+events_unbound00:23:332
10413992825,2cyclictest87766-21kworker/u8:1+events_unbound22:10:241
10413992825,2cyclictest269558-21kworker/u8:2+flush-259:023:25:001
10413992825,2cyclictest165595-21kworker/u8:0+events_unbound21:51:331
10413992824,3cyclictest165595-21kworker/u8:0+flush-259:021:45:211
10411992822,4cyclictest238832-21apt-get22:50:110
10411992822,4cyclictest165559-21latency_hist21:40:010
10411992821,5cyclictest41260-21latency_hist19:40:010
10421992725,2cyclictest285591-21kworker/u8:3+events_unbound23:55:223
10421992724,2cyclictest4361-21kworker/u8:0+events_unbound19:44:333
10421992724,2cyclictest295683-21kworker/u8:2+flush-259:000:07:573
10421992721,4cyclictest335557-21systemd-journal22:13:323
10416992725,2cyclictest285591-21kworker/u8:3+flush-259:023:40:182
10416992724,2cyclictest87766-21kworker/u8:1+flush-259:020:30:212
10416992724,2cyclictest41283-21kworker/u8:2+events_unbound19:59:342
10416992724,2cyclictest295683-21kworker/u8:2+events_unbound00:17:322
10416992723,3cyclictest41283-21kworker/u8:2+events_unbound19:53:332
10416992723,3cyclictest25405-21kworker/u8:2+events_unbound19:22:262
10413992724,2cyclictest4361-21kworker/u8:0+flush-259:019:10:211
10413992724,2cyclictest295683-21kworker/u8:2+events_unbound00:05:221
10413992722,3cyclictest87766-21kworker/u8:1+flush-259:022:10:011
10416992620,4cyclictest335557-21systemd-journal23:30:002
10413992624,2cyclictest4361-21kworker/u8:0+events_unbound19:46:341
10413992623,2cyclictest4361-21kworker/u8:0+events_unbound20:20:221
10411992619,5cyclictest335557-21systemd-journal19:55:010
10421992522,2cyclictest87766-21kworker/u8:1+events_unbound20:55:253
10421992522,2cyclictest87766-21kworker/u8:1+events_unbound20:25:203
10416992522,2cyclictest223126-21kworker/u8:4+flush-259:022:40:252
10416992522,2cyclictest212782-21kworker/u8:0+events_unbound23:55:152
10416992522,2cyclictest134959-21kworker/u8:0+flush-259:021:10:212
10416992517,3cyclictest145024-21kworker/u8:3+events_unbound21:30:212
10413992522,2cyclictest41283-21kworker/u8:2+flush-259:020:00:231
10413992522,2cyclictest315905-21kworker/u8:4+events_unbound00:25:281
10413992522,2cyclictest134959-21kworker/u8:0+events_unbound21:10:231
10413992521,3cyclictest87766-21kworker/u8:1+flush-259:023:00:001
10413992519,2cyclictest87766-21kworker/u8:1+events_unbound21:55:151
10411992520,4cyclictest295683-21kworker/u8:2+flush-259:000:15:160
10416992421,2cyclictest249124-21kworker/u8:3+events_unbound23:00:272
10413992421,2cyclictest87766-21kworker/u8:1+events_unbound21:40:241
10413992421,2cyclictest212782-21kworker/u8:0+flush-259:023:00:231
10413992421,2cyclictest212782-21kworker/u8:0+events_unbound22:45:241
10413992421,2cyclictest145024-21kworker/u8:3+flush-259:021:30:241
10413992420,3cyclictest87766-21kworker/u8:1+flush-259:020:30:161
10413992420,3cyclictest87766-21kworker/u8:1+events_unbound22:31:341
10413992420,3cyclictest212782-21kworker/u8:0+flush-259:023:35:131
10413992420,3cyclictest212782-21kworker/u8:0+events_unbound23:25:211
10413992419,3cyclictest93101-21sh20:29:591
10411992419,3cyclictest87766-21kworker/u8:1+flush-259:023:10:160
10411992419,3cyclictest87766-21kworker/u8:1+flush-259:023:10:160
10411992419,3cyclictest280238-21diskstats23:30:120
10411992418,4cyclictest228269-21latency_hist22:40:000
10421992319,3cyclictest165595-21kworker/u8:0+events_unbound21:45:143
10421992318,3cyclictest15528-21kworker/u8:1+flush-259:020:00:153
10416992321,1cyclictest196937-21sh22:10:012
10416992320,2cyclictest87766-21kworker/u8:1+events_unbound21:50:122
10416992320,2cyclictest113715-21kworker/u8:0+flush-259:020:55:202
10416992319,3cyclictest15528-21kworker/u8:1+flush-259:020:00:122
10413992320,2cyclictest72770-21kworker/u8:3+flush-259:020:40:211
10413992320,2cyclictest191740-21kworker/u8:3+events_unbound22:20:141
10413992319,3cyclictest4361-21kworker/u8:0+flush-259:019:30:011
10413992318,2cyclictest315905-21kworker/u8:4+events_unbound00:20:171
10411992319,3cyclictest87766-21kworker/u8:1+flush-259:023:20:160
10411992316,5cyclictest61845-21latency_hist20:00:000
10421992219,2cyclictest212782-21kworker/u8:0+events_unbound23:43:323
10421992219,2cyclictest113715-21kworker/u8:0+events_unbound21:00:293
10416992218,3cyclictest87766-21kworker/u8:1+events_unbound21:55:192
10416992218,3cyclictest4361-21kworker/u8:0+flush-259:020:20:162
10413992219,2cyclictest212782-21kworker/u8:0+flush-259:023:30:141
10411992218,2cyclictest295683-21kworker/u8:2+events_unbound00:05:180
10411992215,5cyclictest217065-21ntpq22:25:210
10416992118,2cyclictest311175-21kworker/u8:1+flush-259:000:00:132
10416992118,2cyclictest212782-21kworker/u8:0+events_unbound22:45:222
10413992118,2cyclictest87766-21kworker/u8:1+events_unbound22:35:221
10413992117,3cyclictest223126-21kworker/u8:4+flush-259:022:40:151
10411992116,3cyclictest87766-21kworker/u8:1+flush-259:022:00:010
10411992114,5cyclictest119358-21base6420:55:010
10421992017,2cyclictest87766-21kworker/u8:1+events_unbound22:57:483
10421992017,2cyclictest87766-21kworker/u8:1+events_unbound22:22:483
10421992016,3cyclictest87766-21kworker/u8:1+events_unbound22:44:323
10416992017,2cyclictest72770-21kworker/u8:3+events_unbound20:43:322
10416992016,3cyclictest113715-21kworker/u8:0+flush-259:021:00:212
10413992017,2cyclictest191740-21kworker/u8:3+flush-259:022:15:211
10413992016,3cyclictest87766-21kworker/u8:1+flush-259:021:20:211
10411992014,5cyclictest335557-21systemd-journal00:30:000
10411992014,4cyclictest335557-21systemd-journal23:35:010
10411992014,4cyclictest102513-21ntpq20:35:210
10411992013,5cyclictest326804-21cat00:15:010
10421991916,2cyclictest87766-21kworker/u8:1+events_unbound21:39:433
10421991916,2cyclictest72770-21kworker/u8:3+events_unbound20:13:323
10416991916,3cyclictest4361-21kworker/u8:0+events_unbound19:12:252
10416991916,2cyclictest72770-21kworker/u8:3+events_unbound20:45:152
10416991914,3cyclictest36088-21cron19:35:002
10413991917,2cyclictest212782-21kworker/u8:0+events_unbound23:50:271
10413991916,2cyclictest87766-21kworker/u8:1+events_unbound22:25:171
10413991916,2cyclictest326604-21kworker/u8:0+events_unbound00:35:171
10413991916,2cyclictest129587-21kworker/u8:3+events_unbound21:05:201
10411991913,4cyclictest87766-21kworker/u8:1+flush-259:021:15:260
10411991912,5cyclictest201681-21ntpq22:10:220
10411991912,5cyclictest117983-21ntpq20:50:200
10411991912,1cyclictest77712-21turbostat20:15:000
10421991816,1cyclictest212782-21kworker/u8:0+events_unbound23:27:523
10421991815,2cyclictest295683-21kworker/u8:2+events_unbound23:49:573
10421991814,3cyclictest72770-21kworker/u8:3+flush-259:020:33:383
10421991814,3cyclictest285591-21kworker/u8:3+events_unbound23:36:333
10416991815,2cyclictest4361-21kworker/u8:0+events_unbound20:19:332
10416991815,2cyclictest337971-21kworker/u8:3+flush-259:000:25:202
10416991814,3cyclictest335557-21systemd-journal21:27:362
10413991815,2cyclictest249124-21kworker/u8:3+flush-259:023:05:241
10413991815,2cyclictest15528-21kworker/u8:1+flush-259:019:40:191
10413991813,2cyclictest113715-21kworker/u8:0+events_unbound20:55:181
10411991814,3cyclictest2971-21cron21:34:590
10411991814,3cyclictest165595-21kworker/u8:0+flush-259:022:05:010
10421991715,2cyclictest87766-21kworker/u8:1+events_unbound22:50:193
10421991714,2cyclictest87766-21kworker/u8:1+events_unbound23:10:483
10421991714,2cyclictest87766-21kworker/u8:1+events_unbound23:10:483
10421991714,2cyclictest4361-21kworker/u8:0+events_unbound19:10:163
10421991714,2cyclictest234713-21kthreadcore22:45:183
10416991715,2cyclictest295683-21kworker/u8:2+flush-259:023:45:242
10416991714,3cyclictest87766-21kworker/u8:1+events_unbound21:05:332
10416991714,2cyclictest87766-21kworker/u8:1+events_unbound23:10:202
10416991714,2cyclictest87766-21kworker/u8:1+events_unbound23:10:202
10416991714,2cyclictest4361-21kworker/u8:0+flush-259:019:15:152
10416991713,3cyclictest285105-21base6423:35:002
10413991714,3cyclictest212782-21kworker/u8:0+events_unbound22:52:341
10413991714,2cyclictest315905-21kworker/u8:4+flush-259:000:10:241
10413991714,2cyclictest315905-21kworker/u8:4+events_unbound00:30:321
10413991714,2cyclictest212782-21kworker/u8:0+flush-259:023:15:271
10413991714,2cyclictest113715-21kworker/u8:0+events_unbound21:00:121
10411991714,2cyclictest2971-21cron19:35:010
10411991713,3cyclictest301108-21apt-get23:50:130
10411991712,3cyclictest20912-21apt-get19:20:110
10421991614,1cyclictest315905-21kworker/u8:4+flush-259:000:20:383
10421991612,3cyclictest41283-21kworker/u8:2+events_unbound20:06:493
10416991613,2cyclictest509-21rs:main2
10416991612,3cyclictest87766-21kworker/u8:1+events_unbound22:15:142
10416991612,3cyclictest348393-21apt-get00:35:122
10413991614,1cyclictest0-21swapper/123:45:001
10413991613,2cyclictest315905-21kworker/u8:4+flush-259:000:02:571
1041199169,5cyclictest295665-21latency_hist23:45:020
10411991614,2cyclictest61150irq/133-enp0s29f1:tx-000:35:210
10411991614,1cyclictest60350irq/132-enp0s29f1:rx-021:00:080
10411991613,2cyclictest60350irq/132-enp0s29f1:rx-019:10:110
10411991613,2cyclictest165595-21kworker/u8:0+events_unbound21:55:000
10411991612,3cyclictest335557-21systemd-journal20:22:290
10411991612,1cyclictest60350irq/132-enp0s29f1:rx-021:25:160
10411991611,4cyclictest165595-21kworker/u8:0+flush-259:021:40:170
10416991513,2cyclictest212782-21kworker/u8:0+flush-259:022:50:102
10416991512,3cyclictest87766-21kworker/u8:1+events_unbound21:39:322
10416991512,2cyclictest315905-21kworker/u8:4+events_unbound00:34:342
10416991512,2cyclictest295683-21kworker/u8:2+events_unbound00:10:252
10416991512,2cyclictest134959-21kworker/u8:0+events_unbound21:15:262
10411991513,2cyclictest60350irq/132-enp0s29f1:rx-020:47:530
10411991513,1cyclictest60350irq/132-enp0s29f1:rx-023:58:290
10411991513,1cyclictest60350irq/132-enp0s29f1:rx-020:06:500
10411991513,1cyclictest60350irq/132-enp0s29f1:rx-019:42:590
10411991512,2cyclictest60350irq/132-enp0s29f1:rx-023:00:200
10411991512,2cyclictest60350irq/132-enp0s29f1:rx-022:43:330
10411991511,3cyclictest60350irq/132-enp0s29f1:rx-000:00:160
10421991411,2cyclictest87766-21kworker/u8:1+events_unbound21:42:433
10416991411,2cyclictest72770-21kworker/u8:3+events_unbound20:29:572
10416991411,2cyclictest212782-21kworker/u8:0+events_unbound22:30:212
10416991411,2cyclictest171144-21sh21:45:002
10416991410,3cyclictest87766-21kworker/u8:1+events_unbound22:55:552
1041399149,4cyclictest259479-21apt-get23:10:111
1041399149,4cyclictest259479-21apt-get23:10:111
1041199148,4cyclictest129828-21apt-get21:05:110
10411991413,1cyclictest60350irq/132-enp0s29f1:rx-022:30:230
10411991412,1cyclictest60350irq/132-enp0s29f1:rx-019:26:160
10411991412,1cyclictest60350irq/132-enp0s29f1:rx-019:18:430
10411991411,2cyclictest60350irq/132-enp0s29f1:rx-023:05:180
10411991411,2cyclictest60350irq/132-enp0s29f1:rx-020:17:000
10411991411,2cyclictest60350irq/132-enp0s29f1:rx-000:30:180
10411991411,2cyclictest192099-21cpuspeed_turbos22:05:110
10413991310,2cyclictest165595-21kworker/u8:0+flush-259:022:00:241
1041199139,2cyclictest0-21swapper/020:00:160
1041199137,4cyclictest295901-21/usr/sbin/munin23:45:150
1041699128,3cyclictest87766-21kworker/u8:1+flush-259:022:00:552
10413991211,1cyclictest4361-21kworker/u8:0+events_unbound20:15:151
1041199129,2cyclictest233759-21cpuspeed_turbos22:45:140
1041199128,2cyclictest60350irq/132-enp0s29f1:rx-020:30:170
1041199127,3cyclictest335557-21systemd-journal20:30:000
1041399119,2cyclictest15528-21kworker/u8:1+events_unbound19:20:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional