You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 22:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Mar 13, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2461021993935,3cyclictest2512558-21kworker/u8:1+flush-259:008:10:001
2461029993835,2cyclictest2512558-21kworker/u8:1+events_unbound08:30:253
2461029993731,4cyclictest2497048-21latency_hist07:45:003
2461029993633,2cyclictest2710866-21kworker/u8:3+events_unbound11:55:263
2461021993633,2cyclictest2710866-21kworker/u8:3+flush-259:011:55:211
2461015993631,4cyclictest2711063-21/usr/sbin/munin11:10:140
2461029993532,2cyclictest2648614-21kworker/u8:2+events_unbound10:25:253
2461025993529,4cyclictest2607919-21base6409:30:012
2461021993532,2cyclictest2710866-21kworker/u8:3+flush-259:011:45:011
2461021993532,2cyclictest2685045-21kworker/u8:1+flush-259:011:15:161
2461021993532,2cyclictest2523285-21kworker/u8:2+events_unbound09:00:141
2461021993431,2cyclictest2523285-21kworker/u8:2+flush-259:008:25:261
2461015993428,4cyclictest2706065-21diskstats11:05:120
2461029993331,2cyclictest2586264-21kworker/u8:2+events_unbound09:20:263
2461029993329,3cyclictest2471298-21kworker/u8:1+events_unbound07:20:243
2461029993328,4cyclictest2674737-21latency_hist10:35:003
2461015993331,1cyclictest2607652-21kworker/0:1+pm11:59:210
2461029993230,2cyclictest2563934-21kworker/u8:3+events_unbound08:59:223
2461021993228,2cyclictest2685045-21kworker/u8:1+events_unbound10:50:011
2461021993227,4cyclictest2659490-21apt-get10:20:111
2461021993226,2cyclictest2752265-21kworker/u8:2+flush-259:012:30:001
2461021993225,3cyclictest2762781-21kworker/u8:1+events_unbound12:20:141
2461029993127,3cyclictest2477006-21kworker/u8:0+events_unbound08:03:233
2461021993128,2cyclictest2523285-21kworker/u8:2+flush-259:008:35:221
2461021993127,3cyclictest2691450-21kworker/u8:2+flush-259:010:55:001
2461015993127,3cyclictest2487009-21apt-get07:35:110
2461015993125,4cyclictest2721097-21latency_hist11:20:000
2461029993028,2cyclictest2512558-21kworker/u8:1+events_unbound09:07:213
2461029993027,3cyclictest2512558-21kworker/u8:1+events_unbound08:53:233
2461029993027,2cyclictest2563934-21kworker/u8:3+events_unbound09:18:243
2461021993027,2cyclictest2477006-21kworker/u8:0+flush-259:007:25:201
2461021993025,3cyclictest509-21rs:main1
246101599302,26cyclictest2773208-21true12:10:000
2461029992926,2cyclictest2477006-21kworker/u8:0+events_unbound08:05:243
2461025992922,5cyclictest2586281-21latency_hist09:10:012
2461029992825,2cyclictest2612987-21kworker/u8:0+events_unbound09:57:223
2461025992823,3cyclictest252-21systemd-journal11:14:412
2461025992822,4cyclictest2602215-21latency_hist09:25:012
2461021992825,2cyclictest2512558-21kworker/u8:1+flush-259:008:30:191
2461021992824,3cyclictest2752265-21kworker/u8:2+flush-259:012:10:131
2461021992823,3cyclictest2648614-21kworker/u8:2+flush-259:010:10:011
2461015992824,3cyclictest2762781-21kworker/u8:1+flush-259:012:20:150
2461015992820,5cyclictest2591458-21latency_hist09:15:010
2461029992724,2cyclictest2618900-21kworker/u8:3+events_unbound11:02:233
2461029992724,2cyclictest2618900-21kworker/u8:3+events_unbound09:43:233
2461029992724,2cyclictest2612987-21kworker/u8:0+events_unbound10:00:003
2461021992724,2cyclictest2685045-21kworker/u8:1+flush-259:011:05:201
2461021992723,2cyclictest2669617-21kworker/u8:0+flush-259:010:30:211
2461021992722,3cyclictest2633927-21diskstats09:55:131
2461021992722,3cyclictest2528645-21/usr/sbin/munin08:15:141
2461021992722,3cyclictest2407667-21kworker/u8:4+flush-259:007:15:191
2461029992623,2cyclictest2612987-21kworker/u8:0+events_unbound09:45:013
2461025992621,4cyclictest2612987-21kworker/u8:0+flush-259:009:50:162
2461021992622,3cyclictest2685045-21kworker/u8:1+flush-259:011:05:011
2461021992622,3cyclictest2618900-21kworker/u8:3+flush-259:010:00:121
2461021992622,3cyclictest2612987-21kworker/u8:0+flush-259:009:55:001
246101599261,23cyclictest1-21systemd12:19:210
2461025992521,3cyclictest2762781-21kworker/u8:1+events_unbound12:00:002
2461025992519,4cyclictest2518553-21diskstats08:05:122
2461021992522,2cyclictest2538740-21kworker/u8:0+flush-259:008:45:241
2461021992521,2cyclictest2586264-21kworker/u8:2+flush-259:009:25:221
2461015992519,4cyclictest2741312-21ntpq11:35:200
2461015992519,4cyclictest2512546-21latency_hist08:00:010
2461029992421,2cyclictest2762781-21kworker/u8:1+events_unbound12:09:553
2461029992421,2cyclictest2685045-21kworker/u8:1+events_unbound11:17:223
2461029992421,2cyclictest2618900-21kworker/u8:3+events_unbound09:54:283
2461025992421,2cyclictest2523285-21kworker/u8:2+events_unbound09:00:182
2461025992419,4cyclictest2675165-21diskstats10:35:132
2461021992421,2cyclictest2618900-21kworker/u8:3+events_unbound10:40:191
2461021992421,2cyclictest2460530-21kworker/u8:0+flush-259:007:10:211
2461029992321,2cyclictest2612987-21kworker/u8:0+events_unbound10:06:223
2461029992320,2cyclictest2762781-21kworker/u8:1+events_unbound12:14:553
2461029992320,2cyclictest2752265-21kworker/u8:2+events_unbound12:34:213
2461025992317,4cyclictest2618900-21kworker/u8:3+flush-259:011:00:002
2461025992317,4cyclictest252-21systemd-journal09:55:212
2461025992317,4cyclictest252-21systemd-journal09:36:212
2461021992320,2cyclictest2618900-21kworker/u8:3+flush-259:009:40:171
2461021992320,2cyclictest2602238-21kworker/u8:1+flush-259:009:35:111
2461021992319,3cyclictest2477006-21kworker/u8:0+flush-259:008:10:211
2461029992219,2cyclictest2523285-21kworker/u8:2+events_unbound08:39:563
2461029992219,2cyclictest2407667-21kworker/u8:4+events_unbound07:10:343
2461029992218,3cyclictest2477006-21kworker/u8:0+events_unbound07:26:213
2461029992215,5cyclictest2607398-21latency_hist09:30:023
2461025992216,4cyclictest2554286-21base6408:40:002
2461025992216,4cyclictest2543856-21latency_hist08:30:002
2461021992219,2cyclictest2726317-21kworker/u8:0+flush-259:011:50:221
2461021992219,2cyclictest2685045-21kworker/u8:1+events_unbound11:25:021
2461021992219,2cyclictest2618900-21kworker/u8:3+flush-259:010:10:221
2461021992219,2cyclictest2407667-21kworker/u8:4+events_unbound07:30:141
2461021992218,3cyclictest2538740-21kworker/u8:0+events_unbound08:40:171
2461015992217,4cyclictest2726628-21cp11:25:010
2461029992119,2cyclictest2726941-21kworker/u8:2+events_unbound11:32:233
2461025992117,3cyclictest2691450-21kworker/u8:2+flush-259:011:00:242
2461025992117,3cyclictest2618900-21kworker/u8:3+flush-259:009:45:182
2461025992114,5cyclictest2669580-21latency_hist10:30:002
2461021992117,3cyclictest2710866-21kworker/u8:3+flush-259:011:30:101
2461021992117,3cyclictest2477006-21kworker/u8:0+events_unbound07:50:171
2461015992117,3cyclictest2726798-21base6411:25:010
2461015992117,3cyclictest2618900-21kworker/u8:3+flush-259:010:40:150
2461029992018,2cyclictest2477006-21kworker/u8:0+events_unbound07:54:233
2461029992018,2cyclictest2407667-21kworker/u8:4+events_unbound07:31:543
2461029992017,2cyclictest2752265-21kworker/u8:2+events_unbound12:29:223
2461029992017,2cyclictest2752265-21kworker/u8:2+events_unbound12:02:233
2461029992017,2cyclictest2726317-21kworker/u8:0+events_unbound11:54:233
2461029992017,2cyclictest2685045-21kworker/u8:1+events_unbound10:50:033
2461029992017,2cyclictest2669617-21kworker/u8:0+events_unbound10:39:563
2461029992017,2cyclictest2586264-21kworker/u8:2+events_unbound09:39:553
2461025992016,3cyclictest2544116-21apt-get08:30:102
2461025992014,4cyclictest252-21systemd-journal12:13:222
2461021992017,2cyclictest2752265-21kworker/u8:2+flush-259:012:05:131
2461021992017,2cyclictest2656625-21kthreadcore10:15:171
2461021992017,2cyclictest2618900-21kworker/u8:3+flush-259:010:25:101
2461021992017,2cyclictest2563934-21kworker/u8:3+flush-259:009:10:241
2461015992016,3cyclictest252-21systemd-journal10:34:350
2461029991917,2cyclictest2538740-21kworker/u8:0+events_unbound08:40:083
2461029991916,2cyclictest2742263-21kworker/u8:1+events_unbound11:44:593
2461029991916,2cyclictest2618900-21kworker/u8:3+events_unbound10:47:123
2461029991916,2cyclictest2618900-21kworker/u8:3+events_unbound10:19:343
2461029991914,4cyclictest2507640-21apt-get07:55:103
2461021991916,2cyclictest2742263-21kworker/u8:1+events_unbound11:45:221
2461021991916,2cyclictest2586264-21kworker/u8:2+flush-259:009:20:231
2461021991915,3cyclictest2563934-21kworker/u8:3+flush-259:009:15:191
2461021991915,2cyclictest0-21swapper/111:25:011
2461015991916,2cyclictest500-21systemd-logind08:40:000
2461029991816,2cyclictest2752265-21kworker/u8:2+events_unbound12:38:343
2461029991816,2cyclictest2669617-21kworker/u8:0+events_unbound10:43:553
2461029991816,2cyclictest2563934-21kworker/u8:3+events_unbound09:11:153
2461029991816,1cyclictest2705422-21kworker/u8:0+events_unbound11:09:563
2461029991815,2cyclictest2691450-21kworker/u8:2+events_unbound10:57:193
2461029991815,2cyclictest2608511-21irqcore09:30:153
2461025991815,2cyclictest2654745-21irqcore10:15:142
2461025991815,2cyclictest2508051-21irqcore07:55:152
2461025991814,3cyclictest2752265-21kworker/u8:2+flush-259:012:34:592
2461025991813,3cyclictest2563934-21kworker/u8:3+flush-259:008:50:162
2461025991812,5cyclictest2596632-21latency_hist09:20:012
2461025991812,4cyclictest2716390-21diskstats11:15:132
2461025991812,4cyclictest2477006-21kworker/u8:0+flush-259:008:10:152
2461021991815,2cyclictest2726317-21kworker/u8:0+events_unbound11:35:181
2461021991815,2cyclictest2648614-21kworker/u8:2+flush-259:010:35:101
2461021991815,2cyclictest2407667-21kworker/u8:4+events_unbound07:20:111
2461021991814,3cyclictest2486545-21kworker/u8:2+flush-259:007:40:001
2461021991814,2cyclictest2512558-21kworker/u8:1+events_unbound09:05:161
2461015991814,3cyclictest2523285-21kworker/u8:2+flush-259:008:34:560
2461015991814,2cyclictest2580701-21apt-get09:05:030
2461015991813,4cyclictest2658333-21ntpq10:15:200
2461015991810,5cyclictest2481609-21latency_hist07:30:000
2461029991715,2cyclictest2486545-21kworker/u8:2+events_unbound07:39:233
2461029991715,2cyclictest2477006-21kworker/u8:0+events_unbound08:13:003
2461029991714,2cyclictest2710866-21kworker/u8:3+events_unbound11:36:003
2461029991714,2cyclictest2648614-21kworker/u8:2+events_unbound10:10:583
2461029991714,2cyclictest2533270-21kworker/u8:3+events_unbound08:19:013
2461029991714,2cyclictest2407667-21kworker/u8:4+events_unbound07:16:293
2461025991714,2cyclictest2555233-21irqcore08:40:152
2461025991714,2cyclictest2512558-21kworker/u8:1+flush-259:008:15:242
2461025991713,3cyclictest2565115-21apt-config08:50:012
2461025991713,3cyclictest2523285-21kworker/u8:2+flush-259:008:24:422
2461025991713,3cyclictest2407667-21kworker/u8:4+flush-259:007:20:142
2461025991711,4cyclictest252-21systemd-journal11:23:212
2461025991711,4cyclictest2502191-21latency_hist07:50:012
2461021991714,2cyclictest2691450-21kworker/u8:2+events_unbound10:55:241
2461021991714,2cyclictest2618900-21kworker/u8:3+events_unbound09:45:171
2461021991714,2cyclictest2512558-21kworker/u8:1+events_unbound08:58:221
2461015991714,2cyclictest60350irq/132-enp0s29f1:rx-007:40:220
2461015991714,2cyclictest60350irq/132-enp0s29f1:rx-007:18:490
2461015991714,2cyclictest2597729-21irqcore09:20:160
2461015991714,2cyclictest2543851-21cron08:30:010
2461015991711,4cyclictest252-21systemd-journal10:59:400
2461015991710,5cyclictest252-21systemd-journal11:45:010
2461029991615,1cyclictest2710866-21kworker/u8:3+events_unbound11:28:213
2461029991613,2cyclictest2742263-21kworker/u8:1+events_unbound11:45:133
2461029991613,2cyclictest2471298-21kworker/u8:1+events_unbound07:48:043
2461029991610,4cyclictest2783951-21diskstats12:20:123
2461025991613,2cyclictest2726317-21kworker/u8:0+flush-259:011:50:172
2461025991611,4cyclictest2772406-21sshd12:05:212
2461025991611,3cyclictest2710866-21kworker/u8:3+flush-259:011:30:152
2461021991613,2cyclictest2752265-21kworker/u8:2+events_unbound12:15:131
2461021991612,3cyclictest2762781-21kworker/u8:1+flush-259:012:30:211
2461021991612,3cyclictest2685045-21kworker/u8:1+events_unbound11:10:231
2461021991612,3cyclictest2477006-21kworker/u8:0+flush-259:008:00:101
2461015991613,2cyclictest60350irq/132-enp0s29f1:rx-011:00:210
2461015991613,2cyclictest60350irq/132-enp0s29f1:rx-010:00:120
2461015991613,2cyclictest60350irq/132-enp0s29f1:rx-008:09:360
2461015991613,2cyclictest60350irq/132-enp0s29f1:rx-007:34:020
2461015991613,2cyclictest60350irq/132-enp0s29f1:rx-007:10:110
2461015991610,4cyclictest252-21systemd-journal08:50:000
246102999154,6cyclictest2663503-21ntpq10:20:193
246102999153,4cyclictest50-21ksoftirqd/312:15:213
246102999152,5cyclictest2576247-21irqcore09:00:173
2461029991513,2cyclictest2512558-21kworker/u8:1+events_unbound08:46:163
2461029991512,2cyclictest2720892-21kworker/u8:4+events_unbound11:21:543
2461029991512,2cyclictest2705422-21kworker/u8:0+events_unbound11:12:513
2461025991511,3cyclictest2752265-21kworker/u8:2+flush-259:012:00:002
2461021991513,2cyclictest2762781-21kworker/u8:1+events_unbound12:00:111
2461021991512,2cyclictest2523285-21kworker/u8:2+events_unbound08:52:221
2461021991512,2cyclictest2512558-21kworker/u8:1+flush-259:008:20:171
2461021991511,3cyclictest2752265-21kworker/u8:2+events_unbound12:36:231
246101599159,4cyclictest2689242-21ntpq10:45:200
2461015991513,1cyclictest60350irq/132-enp0s29f1:rx-009:00:220
2461015991513,1cyclictest60350irq/132-enp0s29f1:rx-008:10:160
2461015991512,2cyclictest60350irq/132-enp0s29f1:rx-010:12:320
2461015991512,2cyclictest60350irq/132-enp0s29f1:rx-010:05:230
2461015991512,2cyclictest60350irq/132-enp0s29f1:rx-009:36:230
2461015991512,2cyclictest60350irq/132-enp0s29f1:rx-009:15:250
2461015991512,2cyclictest60350irq/132-enp0s29f1:rx-007:50:170
2461015991511,3cyclictest60350irq/132-enp0s29f1:rx-010:50:160
2461015991511,3cyclictest2538740-21kworker/u8:0+flush-259:008:44:580
2461015991511,3cyclictest2477006-21kworker/u8:0+flush-259:008:01:520
2461029991412,2cyclictest2512558-21kworker/u8:1+events_unbound08:22:583
246102599149,3cyclictest2618900-21kworker/u8:3+flush-259:010:20:152
2461025991411,1cyclictest2481839-21/usr/sbin/munin07:30:142
2461025991410,3cyclictest2752265-21kworker/u8:2+flush-259:012:35:242
2461025991410,3cyclictest2685045-21kworker/u8:1+flush-259:010:45:252
246102599140,6cyclictest2466111-21awk07:14:592
2461021991410,3cyclictest2471298-21kworker/u8:1+events_unbound07:41:231
2461015991413,1cyclictest60350irq/132-enp0s29f1:rx-009:50:240
2461015991412,2cyclictest60350irq/132-enp0s29f1:rx-009:44:540
2461015991412,1cyclictest60350irq/132-enp0s29f1:rx-008:15:180
2461015991411,2cyclictest61150irq/133-enp0s29f1:tx-011:50:170
2461015991411,2cyclictest60350irq/132-enp0s29f1:rx-012:36:260
2461015991411,2cyclictest60350irq/132-enp0s29f1:rx-011:30:090
2461015991411,2cyclictest60350irq/132-enp0s29f1:rx-010:25:190
2461015991411,2cyclictest60350irq/132-enp0s29f1:rx-009:30:100
246102599139,3cyclictest2685045-21kworker/u8:1+flush-259:011:05:152
246102599139,3cyclictest2407667-21kworker/u8:4+flush-259:007:15:152
246102599138,3cyclictest2793836-21munin-plugin-st12:30:002
246102599137,4cyclictest2618900-21kworker/u8:3+flush-259:010:10:142
246102599137,4cyclictest252-21systemd-journal08:05:012
246102599131,6cyclictest0-21swapper/211:30:012
246101599139,3cyclictest2669617-21kworker/u8:0+flush-259:010:35:230
246101599139,3cyclictest2565550-21apt-get08:50:110
2461015991312,1cyclictest60350irq/132-enp0s29f1:rx-009:55:310
2461015991311,2cyclictest61150irq/133-enp0s29f1:tx-007:45:130
2461015991311,2cyclictest60350irq/132-enp0s29f1:rx-012:32:370
2461015991311,1cyclictest60350irq/132-enp0s29f1:rx-012:10:110
2461015991311,1cyclictest60350irq/132-enp0s29f1:rx-009:48:390
2461015991310,2cyclictest60350irq/132-enp0s29f1:rx-008:55:120
2461015991310,2cyclictest60350irq/132-enp0s29f1:rx-007:20:070
246102599129,2cyclictest2481614-21idleruntime-cro07:29:592
2461021991210,2cyclictest2492116-21kworker/u8:3+events_unbound07:55:531
246101599129,2cyclictest60350irq/132-enp0s29f1:rx-010:20:120
2461015991210,1cyclictest60350irq/132-enp0s29f1:rx-011:45:260
246102599119,1cyclictest2461010-21cyclictest09:30:012
246102599119,1cyclictest0-21swapper/208:55:242
246102599118,2cyclictest2788272-21unixbench_singl12:20:232
246102599118,2cyclictest2638967-21cpuspeed_turbos10:00:092
246102599117,3cyclictest2778699-21cpuspeed_turbos12:15:122
246102599117,3cyclictest2690622-21fschecks_count10:50:132
246102599115,4cyclictest2726317-21kworker/u8:0+flush-259:011:35:162
246102199118,2cyclictest2477006-21kworker/u8:0+events_unbound07:46:221
246101599118,2cyclictest60350irq/132-enp0s29f1:rx-012:00:240
246102599108,1cyclictest0-21swapper/211:50:012
246102599105,3cyclictest490-21dbus-daemon10:45:002
24610259991,6cyclictest2747458-21munin-run11:45:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional