You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 07:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Jul 14, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2447975993025,4cyclictest2760663-21base6400:10:012
2447979992922,5cyclictest2624604-21latency_hist22:00:013
2447969992923,4cyclictest2520617-21latency_hist20:20:020
2447973992822,5cyclictest335557-21systemd-journal21:45:011
2447969992820,6cyclictest2634930-21latency_hist22:10:020
2447975992723,3cyclictest509-21rs:main2
2447973992720,5cyclictest2613943-21gpgv21:50:001
2447975992623,2cyclictest2582463-21kworker/u8:5+events_unbound21:45:152
2447973992521,3cyclictest2629974-21kworker/u8:0+flush-259:023:46:481
2447969992418,4cyclictest2718593-21apt-get23:30:010
244796999241,21cyclictest2536060-21unin-run20:35:010
2447975992319,3cyclictest2555959-21kworker/u8:2+events_unbound20:51:132
2447975992318,3cyclictest2640235-21base6422:15:012
2447973992320,2cyclictest2645146-21kworker/u8:1+events_unbound22:30:201
2447973992320,2cyclictest2515701-21kworker/u8:3+flush-259:021:35:171
2447973992319,3cyclictest2665472-21kworker/u8:2+flush-259:023:00:171
2447973992318,3cyclictest509-21rs:main1
2447969992318,3cyclictest2645146-21kworker/u8:1+flush-259:022:20:170
2447973992220,2cyclictest2567174-21kworker/u8:4+flush-259:021:25:181
2447973992219,2cyclictest2577270-21sh21:15:001
2447973992218,3cyclictest2566577-21kworker/u8:0+flush-259:021:20:001
2447973992218,3cyclictest2525778-21kworker/u8:0+flush-259:020:35:231
2447969992218,3cyclictest500-21systemd-logind22:35:010
2447969992215,5cyclictest2656037-21latency_hist22:30:010
2447979992117,3cyclictest2474018-21apt-get19:35:123
2447975992118,2cyclictest2734762-21kworker/u8:4+events_unbound00:00:132
2447975992117,3cyclictest2457937-21kworker/u8:0+flush-259:019:25:162
2447973992117,3cyclictest2707866-21kworker/u8:1+flush-259:023:40:011
2447973992116,4cyclictest2582712-21apt-get21:20:131
2447973992115,4cyclictest335557-21systemd-journal20:10:011
2447969992116,3cyclictest2645702-21kworker/u8:3+flush-259:022:50:200
2447969992114,5cyclictest2708732-21diskstats23:20:150
2447969992114,5cyclictest2708732-21diskstats23:20:140
2447979992011,8cyclictest0-21swapper/323:50:013
2447975992017,2cyclictest507-21in:imuxsock22:20:002
2447975992017,2cyclictest2707866-21kworker/u8:1+flush-259:000:25:262
2447975992017,2cyclictest2484304-21kworker/u8:3+flush-259:019:45:212
2447975992017,2cyclictest2468616-21kworker/u8:2+events_unbound20:20:162
2447975992017,2cyclictest2468616-21kworker/u8:2+events_unbound20:05:202
2447975992016,3cyclictest2707866-21kworker/u8:1+flush-259:023:20:202
2447975992016,3cyclictest2707866-21kworker/u8:1+flush-259:023:20:192
2447975992015,4cyclictest2515668-21cat20:15:012
2447973992017,2cyclictest2707866-21kworker/u8:1+flush-259:023:20:171
2447973992017,2cyclictest2707866-21kworker/u8:1+flush-259:023:20:171
2447973992016,3cyclictest2525778-21kworker/u8:0+events_unbound20:30:131
2447969992015,3cyclictest509-21rs:main0
2447969992014,4cyclictest2619416-21latency_hist21:55:020
244797999196,9cyclictest0-21swapper/300:11:193
2447979991913,4cyclictest335557-21systemd-journal21:51:283
2447975991916,2cyclictest2665472-21kworker/u8:2+events_unbound23:00:122
2447975991916,2cyclictest2629974-21kworker/u8:0+flush-259:022:55:252
2447975991915,3cyclictest2567174-21kworker/u8:4+events_unbound21:10:002
2447973991916,2cyclictest2567174-21kworker/u8:4+flush-259:021:50:171
2447973991916,2cyclictest2567174-21kworker/u8:4+flush-259:021:30:151
2447973991916,2cyclictest2468616-21kworker/u8:2+flush-259:019:40:251
2447973991915,3cyclictest335557-21systemd-journal19:38:131
2447973991915,3cyclictest2776236-21kworker/u8:3+events_unbound00:30:141
2447973991915,3cyclictest2494401-21latency_hist19:55:011
2447973991915,3cyclictest2457937-21kworker/u8:0+flush-259:019:20:181
244797999189,7cyclictest2458946-21irqcore19:20:173
2447979991816,1cyclictest2686896-21sh23:00:003
2447979991815,1cyclictest0-21swapper/323:20:003
2447979991812,4cyclictest2567174-21kworker/u8:4+flush-259:021:40:183
244797999181,16cyclictest2551499-21latency_hist20:50:003
244797999180,4cyclictest2676246-21taskset22:46:163
244797999180,3cyclictest2782059-21/usr/sbin/munin00:30:233
244797999180,2cyclictest2596457-21grep21:30:183
244797999180,2cyclictest2494539-21cat19:55:013
244797999180,16cyclictest2546344-21cron20:45:003
2447975991815,2cyclictest2645702-21kworker/u8:3+events_unbound22:40:162
2447975991815,2cyclictest2468616-21kworker/u8:2+events_unbound20:02:142
2447975991814,3cyclictest2484304-21kworker/u8:3+events_unbound19:50:162
2447975991814,3cyclictest2426667-21kworker/u8:4+flush-259:019:15:192
2447975991813,3cyclictest509-21rs:main2
2447975991813,3cyclictest2661188-21cut22:35:002
2447973991815,2cyclictest2457937-21kworker/u8:0+events_unbound19:25:151
2447973991815,1cyclictest0-21swapper/123:45:001
2447973991814,3cyclictest2776236-21kworker/u8:3+flush-259:000:30:001
2447973991814,3cyclictest2645702-21kworker/u8:3+events_unbound22:40:171
2447969991814,2cyclictest2606107-21kthreadcore21:40:190
2447969991813,4cyclictest2707866-21kworker/u8:1+flush-259:000:10:160
2447969991812,4cyclictest335557-21systemd-journal23:11:400
2447969991812,4cyclictest2514123-21ntpq20:10:190
2447969991811,5cyclictest2754378-21ntpq00:00:230
244797999179,7cyclictest0-21swapper/321:50:013
244797999174,12cyclictest2554375-21cut20:50:203
2447979991714,2cyclictest2627159-21kthreadcore22:00:173
244797999171,13cyclictest2109693-21snmpd23:35:163
244797999170,2cyclictest2520882-21taskset20:20:133
2447975991714,2cyclictest2718445-21kworker/u8:3+events_unbound23:41:472
2447975991714,2cyclictest2582463-21kworker/u8:5+events_unbound21:55:212
2447975991714,2cyclictest2457937-21kworker/u8:0+events_unbound19:20:202
2447975991713,3cyclictest2567174-21kworker/u8:4+flush-259:022:00:102
2447975991713,3cyclictest2567174-21kworker/u8:4+flush-259:021:40:202
2447975991713,3cyclictest2567174-21kworker/u8:4+flush-259:021:15:322
2447975991713,2cyclictest0-21swapper/219:40:002
2447973991714,2cyclictest2702976-21apt-get23:15:121
2447973991714,2cyclictest2546384-21kworker/u8:1+flush-259:020:55:251
2447973991714,2cyclictest2484746-21irqcore19:45:171
2447973991714,2cyclictest2468616-21kworker/u8:2+events_unbound20:20:211
2447973991714,2cyclictest0-21swapper/119:20:001
2447973991713,3cyclictest2525778-21kworker/u8:0+flush-259:020:45:211
2447973991713,3cyclictest2468616-21kworker/u8:2+events_unbound20:25:151
2447973991713,3cyclictest2468616-21kworker/u8:2+events_unbound20:10:141
2447969991714,2cyclictest2447963-21cyclictest21:00:000
2447969991713,3cyclictest2484304-21kworker/u8:3+flush-259:019:55:270
2447969991713,2cyclictest2603128-21sh21:40:000
2447969991711,4cyclictest2458531-21apt-get19:20:110
2447969991710,5cyclictest2644814-21ntpq22:15:230
244797999169,4cyclictest2598371-21diskstats21:35:143
244797999166,8cyclictest2787584-21gltestperf00:35:163
244797999164,10cyclictest2515049-21latency_hist20:15:013
244797999161,1cyclictest2639156-21ntpq22:10:223
244797999161,14cyclictest0-21swapper/321:25:003
244797999161,13cyclictest2661166-21awk22:35:003
244797999161,13cyclictest2651576-21irqcore22:25:173
244797999161,13cyclictest2650898-21apt22:25:003
244797999161,11cyclictest2755483-21apt-get00:05:153
244797999160,4cyclictest2666550-21/usr/sbin/munin22:40:173
244797999160,2cyclictest2781791-21wc00:30:013
244797999160,2cyclictest2498736-21ntpq19:55:253
244797999160,14cyclictest335557-21systemd-journal19:35:003
244797999160,14cyclictest2645685-21latency_hist22:20:003
244797999160,13cyclictest2526170-21cpuspeed_turbos20:25:133
244797599169,5cyclictest2592813-21latency_hist21:30:002
2447975991613,2cyclictest2525778-21kworker/u8:0+events_unbound20:40:142
2447975991613,2cyclictest2447963-21cyclictest21:25:002
2447975991612,3cyclictest2771087-21kworker/u8:2+flush-259:000:20:112
2447975991612,3cyclictest2761028-21apt-get00:10:132
2447975991611,4cyclictest2582463-21kworker/u8:5+flush-259:021:30:112
244797599161,13cyclictest1-21systemd21:05:012
2447973991614,1cyclictest2620708-21kthreadcore21:55:201
2447973991613,2cyclictest2640341-21apt-config22:15:011
2447973991613,2cyclictest2582463-21kworker/u8:5+flush-259:022:15:261
2447973991612,3cyclictest2645146-21kworker/u8:1+flush-259:022:25:191
2447973991612,3cyclictest2394947-21kworker/u8:2+events_unbound19:12:141
244796999169,5cyclictest2550597-21ntpq20:45:220
2447969991613,2cyclictest60350irq/132-enp0s29f1:rx-022:35:220
2447969991613,2cyclictest60350irq/132-enp0s29f1:rx-019:35:180
2447969991613,2cyclictest60350irq/132-enp0s29f1:rx-019:25:200
2447969991613,2cyclictest2687584-21irqcore23:00:170
2447969991613,2cyclictest2526448-21irqcore20:25:170
244797999154,9cyclictest2698855-21kthreadcore23:10:183
244797999153,10cyclictest2534774-21tr20:30:193
244797999152,10cyclictest2697407-21apt-key23:10:013
244797999151,4cyclictest2708550-21acpi23:20:123
244797999151,4cyclictest2708550-21acpi23:20:113
244797999151,1cyclictest2718869-21latency_hist23:30:003
244797999151,12cyclictest2687573-21tr23:00:163
244797999151,12cyclictest2509893-21cron20:10:003
244797999151,12cyclictest2457442-21ntpq19:15:223
244797999151,11cyclictest2577675-21cpuspeed_turbos21:15:153
2447979991510,4cyclictest2515701-21kworker/u8:3+flush-259:021:05:003
244797999150,3cyclictest2745598-21irqcore23:55:183
244797999150,3cyclictest2662755-21cat22:35:163
244797999150,3cyclictest2558666-21tr20:55:183
244797999150,2cyclictest2572079-21basename21:10:003
244797999150,14cyclictest2724203-21idleruntime-cro23:35:003
244797999150,13cyclictest2744911-21turbostat23:55:003
244797999150,13cyclictest2681721-21idleruntime-cro22:54:593
244797599159,4cyclictest2697782-21cp23:10:002
2447975991512,2cyclictest2782512-21irqcore00:30:162
2447975991511,3cyclictest2629974-21kworker/u8:0+events_unbound23:45:122
2447975991511,3cyclictest2504975-21kworker/u8:0+events_unbound20:11:142
2447975991511,3cyclictest2458498-21kworker/u8:1+events_unbound19:44:142
2447975991511,2cyclictest0-21swapper/223:35:002
2447973991512,3cyclictest2629974-21kworker/u8:0+flush-259:023:51:501
2447973991512,2cyclictest2665472-21kworker/u8:2+flush-259:023:10:151
2447973991512,2cyclictest2645702-21kworker/u8:3+flush-259:022:50:251
2447973991512,2cyclictest2567174-21kworker/u8:4+events_unbound21:05:141
2447973991512,2cyclictest2494412-21kworker/u8:1+events_unbound20:15:181
2447973991511,3cyclictest2771087-21kworker/u8:2+events_unbound00:20:131
2447973991511,3cyclictest2468616-21kworker/u8:2+events_unbound19:56:151
2447969991514,1cyclictest60350irq/132-enp0s29f1:rx-019:50:100
2447969991513,2cyclictest60350irq/132-enp0s29f1:rx-023:47:190
2447969991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:190
2447969991513,1cyclictest60350irq/132-enp0s29f1:rx-021:25:170
2447969991513,1cyclictest60350irq/132-enp0s29f1:rx-020:05:180
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-022:45:150
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-021:45:140
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-020:50:160
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-020:40:150
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-020:00:210
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-019:42:090
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-000:32:480
2447969991512,2cyclictest60350irq/132-enp0s29f1:rx-000:28:540
2447969991511,3cyclictest2566577-21kworker/u8:0+flush-259:021:05:200
244797999141,4cyclictest2499998-21df20:00:143
244797999141,2cyclictest2588074-21df_inode21:25:143
244797999141,11cyclictest2483143-21ntpq19:40:213
244797999140,3cyclictest2766478-21fw_conntrack00:15:133
244797999140,3cyclictest2734303-21chrt23:42:193
244797999140,2cyclictest2572777-21sed21:10:153
244797999140,2cyclictest2515872-21grep20:15:143
244797999140,2cyclictest2484336-21modprobe19:45:133
244797999140,2cyclictest2448854-21sed19:10:163
244797999140,12cyclictest2773611-21ps00:20:163
244797999140,12cyclictest2755206-21awk00:05:013
244797999140,12cyclictest2463760-21grep19:25:133
2447975991411,2cyclictest2734762-21kworker/u8:4+events_unbound00:15:162
2447975991411,2cyclictest2645702-21kworker/u8:3+flush-259:022:45:202
2447975991411,2cyclictest2629974-21kworker/u8:0+events_unbound23:55:242
2447975991411,1cyclictest0-21swapper/219:10:162
2447975991410,3cyclictest2734762-21kworker/u8:4+flush-259:023:50:242
2447975991410,3cyclictest2567174-21kworker/u8:4+events_unbound21:50:132
2447975991410,3cyclictest2567174-21kworker/u8:4+events_unbound21:10:242
2447975991410,3cyclictest2468616-21kworker/u8:2+events_unbound19:55:252
2447975991410,3cyclictest2458498-21kworker/u8:1+events_unbound19:34:572
2447973991412,1cyclictest2734762-21kworker/u8:4+events_unbound00:00:151
2447973991411,2cyclictest2525778-21kworker/u8:0+events_unbound20:40:261
2447973991410,3cyclictest2707866-21kworker/u8:1+events_unbound00:10:121
2447973991410,3cyclictest2629974-21kworker/u8:0+flush-259:023:05:171
244796999149,4cyclictest335557-21systemd-journal23:06:130
244796999149,3cyclictest335557-21systemd-journal21:01:330
244796999149,2cyclictest60350irq/132-enp0s29f1:rx-019:10:110
244796999148,4cyclictest335557-21systemd-journal21:31:350
2447969991413,1cyclictest60350irq/132-enp0s29f1:rx-023:43:580
2447969991413,1cyclictest60350irq/132-enp0s29f1:rx-021:56:320
2447969991412,1cyclictest60350irq/132-enp0s29f1:rx-023:50:200
2447969991412,1cyclictest60350irq/132-enp0s29f1:rx-021:10:160
2447969991412,1cyclictest60350irq/132-enp0s29f1:rx-000:20:230
2447969991411,2cyclictest60350irq/132-enp0s29f1:rx-020:35:170
2447969991411,2cyclictest60350irq/132-enp0s29f1:rx-019:15:030
2447969991411,2cyclictest60350irq/132-enp0s29f1:rx-000:35:460
2447969991411,2cyclictest60350irq/132-enp0s29f1:rx-000:05:200
244797999131,2cyclictest2536282-21find20:35:103
244797999131,10cyclictest2448004-21wc19:10:013
244797599139,3cyclictest2724232-21kworker/u8:2+events_unbound23:35:132
244797599139,2cyclictest0-21swapper/222:25:182
2447975991310,2cyclictest2629974-21kworker/u8:0+events_unbound23:05:242
2447975991310,2cyclictest2525778-21kworker/u8:0+events_unbound20:30:172
244797399139,3cyclictest2629974-21kworker/u8:0+flush-259:022:05:151
244797399138,3cyclictest509-21rs:main1
2447973991310,2cyclictest2686414-21unixbench_multi22:55:261
2447973991310,2cyclictest2665472-21kworker/u8:2+flush-259:023:25:161
2447973991310,2cyclictest2645948-21apt-get22:20:121
244797399130,11cyclictest1-21systemd00:18:131
244796999137,4cyclictest2582463-21kworker/u8:5+flush-259:022:15:000
244796999131,3cyclictest2707882-21munin-run23:20:000
2447969991312,1cyclictest60350irq/132-enp0s29f1:rx-022:40:160
2447969991311,1cyclictest60350irq/132-enp0s29f1:rx-023:35:200
2447969991311,1cyclictest60350irq/132-enp0s29f1:rx-020:20:140
2447969991311,1cyclictest60350irq/132-enp0s29f1:rx-019:47:450
2447969991311,1cyclictest60350irq/132-enp0s29f1:rx-000:15:160
2447969991310,2cyclictest60350irq/132-enp0s29f1:rx-021:21:300
244797599128,3cyclictest2718445-21kworker/u8:3+events_unbound23:29:152
244797599128,3cyclictest2468616-21kworker/u8:2+events_unbound20:25:132
244797599127,3cyclictest2567174-21kworker/u8:4+flush-259:021:35:052
244797399129,2cyclictest2791718-21unixbench_multi00:35:251
244797399129,2cyclictest2555959-21kworker/u8:2+flush-259:021:00:151
244797399129,2cyclictest2515701-21kworker/u8:3+events_unbound20:50:171
2447973991210,1cyclictest0-21swapper/122:45:151
244796999129,2cyclictest2745585-21irqcore23:55:170
244797399118,2cyclictest2629974-21kworker/u8:0+flush-259:022:35:111
244797399118,2cyclictest2468616-21kworker/u8:2+flush-259:020:00:201
244797399118,2cyclictest2457937-21kworker/u8:0+events_unbound19:30:191
244797599107,2cyclictest2734762-21kworker/u8:4+flush-259:000:35:202
244797599107,2cyclictest2634074-21ntpq22:05:212
24479739994,3cyclictest2624865-21apt-get22:00:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional