You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 06:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Jul 03, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
834037995248,3cyclictest75-21kswapd022:41:230
834048995148,2cyclictest958161-21kworker/u8:4+events_unbound21:40:003
834048994845,2cyclictest974151-21kworker/u8:3+events_unbound22:15:233
834048994845,2cyclictest885910-21kworker/u8:2+events_unbound20:55:013
834048994743,3cyclictest999822-21kworker/u8:0+events_unbound21:50:183
834048994743,3cyclictest875620-21gpgv19:50:003
834048994743,3cyclictest1104670-21kworker/u8:3+events_unbound23:35:213
834040994743,3cyclictest916907-21kworker/u8:0+flush-259:020:40:011
834048994643,2cyclictest958161-21kworker/u8:4+flush-259:022:50:003
834040994640,4cyclictest335557-21systemd-journal19:55:001
834044994541,3cyclictest958161-21kworker/u8:4+events_unbound22:10:142
834044994539,4cyclictest833961-21latency_hist19:10:012
834048994441,2cyclictest916907-21kworker/u8:0+events_unbound21:20:253
834048994340,2cyclictest958161-21kworker/u8:4+events_unbound23:20:163
834048994340,2cyclictest885910-21kworker/u8:2+flush-259:021:30:173
834048994239,2cyclictest891475-21kworker/u8:1+events_unbound20:20:243
834037994229,11cyclictest869575-21ntpq19:40:220
834040994138,2cyclictest916907-21kworker/u8:0+events_unbound20:30:001
834048994037,2cyclictest916907-21kworker/u8:0+flush-259:020:35:253
834044994036,3cyclictest974151-21kworker/u8:3+flush-259:022:15:222
834044994035,3cyclictest1046369-21latency_hist22:35:002
834048993936,2cyclictest958161-21kworker/u8:4+events_unbound23:15:173
834048993936,2cyclictest854610-21kworker/u8:1+events_unbound19:55:203
834048993936,2cyclictest812828-21kworker/u8:0+flush-259:019:50:253
834048993936,2cyclictest812828-21kworker/u8:0+events_unbound19:30:213
834044993932,5cyclictest1082491-21ntpq23:05:202
834040993934,4cyclictest957535-21ntpq21:05:221
834048993836,1cyclictest1120209-21kworker/u8:2+events_unbound00:05:193
834048993835,2cyclictest974151-21kworker/u8:3+events_unbound22:25:173
834048993835,2cyclictest885910-21kworker/u8:2+flush-259:020:10:213
834048993835,2cyclictest885910-21kworker/u8:2+flush-259:020:10:213
834048993835,2cyclictest885910-21kworker/u8:2+events_unbound21:00:233
834048993835,2cyclictest1120209-21kworker/u8:2+flush-259:000:15:153
834048993835,2cyclictest1104670-21kworker/u8:3+flush-259:023:40:243
834048993835,2cyclictest1020659-21kworker/u8:1+flush-259:022:20:253
834044993835,2cyclictest75-21kswapd022:41:242
834037993825,11cyclictest335557-21systemd-journal20:25:450
834048993734,2cyclictest958161-21kworker/u8:4+flush-259:021:40:203
834048993734,2cyclictest885910-21kworker/u8:2+events_unbound21:09:463
834048993734,2cyclictest1167206-21kworker/u8:3+flush-259:000:35:153
834048993733,3cyclictest75-21kswapd022:41:243
834044993733,3cyclictest1120209-21kworker/u8:2+flush-259:000:15:002
834040993630,5cyclictest962700-21ntpq21:10:201
834048993532,2cyclictest1062013-21kworker/u8:0+events_unbound23:05:223
834048993532,2cyclictest1046108-21kworker/u8:1+events_unbound22:35:163
834044993531,3cyclictest1020659-21kworker/u8:1+flush-259:022:20:172
834037993526,6cyclictest335557-21systemd-journal23:54:590
834048993431,2cyclictest974151-21kworker/u8:3+events_unbound21:45:233
834048993431,2cyclictest891475-21kworker/u8:1+events_unbound20:25:023
834048993431,2cyclictest885910-21kworker/u8:2+events_unbound20:55:143
834048993430,3cyclictest968729-21latency_hist21:20:013
834044993431,2cyclictest885910-21kworker/u8:2+flush-259:020:05:242
834044993430,3cyclictest812828-21kworker/u8:0+events_unbound19:30:002
834037993428,4cyclictest901797-21kworker/u8:3+flush-259:020:45:010
834037993426,5cyclictest942984-21latency_hist20:55:000
834048993331,2cyclictest1062013-21kworker/u8:0+flush-259:023:10:253
834048993330,2cyclictest885910-21kworker/u8:2+flush-259:021:25:183
834040993330,2cyclictest885910-21kworker/u8:2+events_unbound21:40:241
834037993327,4cyclictest963821-21/usr/sbin/munin21:15:150
834037993319,12cyclictest1156192-21ntpq00:15:210
834044993229,2cyclictest958161-21kworker/u8:4+flush-259:023:20:012
834044993229,2cyclictest901797-21kworker/u8:3+flush-259:020:37:152
834044993228,3cyclictest1130576-21kworker/u8:1+events_unbound23:55:002
834040993228,3cyclictest999822-21kworker/u8:0+flush-259:021:50:001
834040993228,3cyclictest885910-21kworker/u8:2+flush-259:020:50:011
834048993129,2cyclictest1130576-21kworker/u8:1+flush-259:000:10:163
834048993128,2cyclictest958161-21kworker/u8:4+events_unbound22:10:203
834048993128,2cyclictest1093720-21kworker/u8:0+events_unbound23:45:013
834048993126,3cyclictest1109376-21cp23:35:013
834044993127,2cyclictest999822-21kworker/u8:0+flush-259:021:50:242
834037993124,5cyclictest921444-21ntpq20:30:220
834037993123,5cyclictest1051052-21ntpq22:35:200
834048993027,2cyclictest839173-21kworker/u8:2+flush-259:019:15:163
834048993027,2cyclictest812828-21kworker/u8:0+flush-259:019:35:143
834048993027,2cyclictest1136267-21kworker/u8:3+flush-259:000:00:203
834048993026,3cyclictest885910-21kworker/u8:2+events_unbound21:10:153
834044993027,2cyclictest974151-21kworker/u8:3+events_unbound22:00:282
834044993027,2cyclictest885910-21kworker/u8:2+flush-259:021:00:012
834044993027,2cyclictest870475-21kworker/u8:3+flush-259:019:55:242
834044993026,3cyclictest974151-21kworker/u8:3+flush-259:021:30:012
834044993026,3cyclictest859704-21apt-get19:35:012
834044993026,3cyclictest1036095-21kworker/u8:0+events_unbound22:27:242
834040993027,2cyclictest916907-21kworker/u8:0+flush-259:020:50:231
834040993027,2cyclictest1062013-21kworker/u8:0+flush-259:023:00:251
834048992926,2cyclictest974151-21kworker/u8:3+events_unbound22:30:243
834048992926,2cyclictest891475-21kworker/u8:1+events_unbound20:15:213
834048992925,3cyclictest901797-21kworker/u8:3+events_unbound20:30:143
834044992924,4cyclictest1135965-21latency_hist00:00:002
834040992926,2cyclictest974151-21kworker/u8:3+flush-259:021:50:451
834040992926,2cyclictest1104670-21kworker/u8:3+flush-259:023:42:521
834040992925,3cyclictest1088405-21kworker/u8:2+events_unbound23:25:181
834037992924,4cyclictest1104670-21kworker/u8:3+flush-259:023:50:000
834037992924,3cyclictest849666-21/usr/sbin/munin19:25:140
834037992923,4cyclictest1000088-21latency_hist21:49:590
834048992825,2cyclictest854610-21kworker/u8:1+events_unbound19:40:203
834044992825,2cyclictest891475-21kworker/u8:1+flush-259:020:15:212
834044992825,2cyclictest1088405-21kworker/u8:2+events_unbound23:20:202
834044992824,3cyclictest916907-21kworker/u8:0+events_unbound21:13:462
834044992824,3cyclictest885910-21kworker/u8:2+flush-259:020:52:152
834040992825,2cyclictest974151-21kworker/u8:3+flush-259:022:05:211
834040992825,2cyclictest1062013-21kworker/u8:0+flush-259:023:10:211
834037992823,4cyclictest812828-21kworker/u8:0+flush-259:020:05:170
834037992820,5cyclictest335557-21systemd-journal22:22:540
834044992724,2cyclictest885910-21kworker/u8:2+flush-259:021:30:222
834044992724,2cyclictest1093720-21kworker/u8:0+events_unbound23:40:012
834044992723,3cyclictest885910-21kworker/u8:2+events_unbound21:00:292
834040992724,2cyclictest974151-21kworker/u8:3+events_unbound22:23:471
834040992724,2cyclictest958161-21kworker/u8:4+events_unbound22:13:461
834040992723,3cyclictest974151-21kworker/u8:3+events_unbound22:18:451
834040992723,3cyclictest958161-21kworker/u8:4+flush-259:021:30:011
834040992723,3cyclictest1068130-21apt-get22:55:111
834040992723,3cyclictest1051719-21kworker/u8:0+flush-259:022:40:001
834040992723,3cyclictest1046108-21kworker/u8:1+events_unbound22:32:571
834048992623,2cyclictest885910-21kworker/u8:2+events_unbound20:45:223
834048992623,2cyclictest818324-21kworker/u8:4+events_unbound19:20:143
834048992623,2cyclictest812828-21kworker/u8:0+flush-259:019:25:193
834048992623,2cyclictest75-21kswapd022:50:023
834048992623,2cyclictest1130576-21kworker/u8:1+flush-259:023:55:213
834044992622,3cyclictest885910-21kworker/u8:2+flush-259:021:25:002
834044992622,3cyclictest854610-21kworker/u8:1+events_unbound19:45:442
834044992622,3cyclictest818324-21kworker/u8:4+events_unbound19:22:282
834040992622,3cyclictest854610-21kworker/u8:1+events_unbound19:37:431
834040992621,4cyclictest1130576-21kworker/u8:1+flush-259:000:15:001
834040992621,2cyclictest1062013-21kworker/u8:0+events_unbound23:10:011
834037992619,5cyclictest911162-21ntpq20:20:210
834048992521,3cyclictest974151-21kworker/u8:3+events_unbound22:05:213
834044992522,2cyclictest885910-21kworker/u8:2+flush-259:021:07:212
834044992520,3cyclictest335557-21systemd-journal22:05:452
834040992522,2cyclictest854610-21kworker/u8:1+events_unbound19:40:251
834040992522,2cyclictest818324-21kworker/u8:4+events_unbound19:10:231
834040992522,2cyclictest812828-21kworker/u8:0+events_unbound20:05:151
834040992521,3cyclictest1151951-21kworker/u8:0+events_unbound00:34:511
834040992520,4cyclictest948387-21apt-get21:00:121
834037992520,4cyclictest839173-21kworker/u8:2+flush-259:019:15:130
834037992519,4cyclictest818324-21kworker/u8:4+flush-259:019:20:170
834037992519,4cyclictest1014658-21ntpq22:00:230
834037992518,5cyclictest509-21rs:main0
834048992421,3cyclictest1093720-21kworker/u8:0+events_unbound23:50:083
834048992418,4cyclictest834227-21/usr/sbin/munin19:10:153
834044992421,2cyclictest901797-21kworker/u8:3+flush-259:020:40:192
834044992421,2cyclictest854610-21kworker/u8:1+flush-259:019:45:002
834044992420,3cyclictest974151-21kworker/u8:3+flush-259:021:55:162
834044992420,3cyclictest854830-21apt-get19:30:112
834044992419,4cyclictest881127-21latency_hist19:55:002
834040992421,2cyclictest1130576-21kworker/u8:1+events_unbound23:55:221
834040992420,3cyclictest885910-21kworker/u8:2+flush-259:021:30:271
834040992420,3cyclictest812828-21kworker/u8:0+events_unbound19:17:281
834040992420,3cyclictest1104670-21kworker/u8:3+events_unbound23:45:171
834040992420,3cyclictest1104670-21kworker/u8:3+events_unbound23:35:011
834040992420,3cyclictest1088766-21apt-get23:15:121
834037992420,3cyclictest958161-21kworker/u8:4+flush-259:022:55:000
834037992418,4cyclictest859703-21latency_hist19:35:000
834048992320,2cyclictest1067889-21kworker/u8:2+events_unbound22:55:263
834048992319,3cyclictest812828-21kworker/u8:0+flush-259:020:00:193
834044992320,2cyclictest958161-21kworker/u8:4+flush-259:022:35:212
834040992320,2cyclictest1120209-21kworker/u8:2+events_unbound00:05:241
834040992319,3cyclictest901797-21kworker/u8:3+flush-259:020:30:201
834040992319,3cyclictest1062013-21kworker/u8:0+flush-259:022:50:161
834037992316,5cyclictest1136009-21cp00:00:000
834037992316,3cyclictest1-21systemd21:30:010
834048992218,3cyclictest1130576-21kworker/u8:1+flush-259:000:25:053
834044992219,2cyclictest916907-21kworker/u8:0+flush-259:020:45:272
834044992219,2cyclictest885910-21kworker/u8:2+events_unbound21:45:142
834044992219,2cyclictest1120209-21kworker/u8:2+flush-259:000:23:212
834044992219,2cyclictest1104670-21kworker/u8:3+flush-259:023:30:242
834044992219,2cyclictest1062013-21kworker/u8:0+flush-259:022:50:212
834044992218,3cyclictest818324-21kworker/u8:4+flush-259:019:10:192
834044992218,3cyclictest1088405-21kworker/u8:2+events_unbound23:25:142
834044992218,3cyclictest1062290-21apt-get22:50:002
834040992219,2cyclictest916907-21kworker/u8:0+events_unbound20:55:171
834040992219,2cyclictest818324-21kworker/u8:4+flush-259:019:20:131
834040992219,2cyclictest1093720-21kworker/u8:0+flush-259:023:37:511
834040992218,3cyclictest335557-21systemd-journal23:25:001
834040992218,3cyclictest335557-21systemd-journal21:55:451
834040992215,3cyclictest891475-21kworker/u8:1+flush-259:020:15:201
834048992119,2cyclictest999822-21kworker/u8:0+events_unbound21:56:463
834048992118,2cyclictest1062013-21kworker/u8:0+flush-259:023:00:503
834048992117,3cyclictest1088405-21kworker/u8:2+events_unbound23:25:243
834044992118,2cyclictest885910-21kworker/u8:2+flush-259:021:40:142
834044992118,2cyclictest1120209-21kworker/u8:2+events_unbound00:15:222
834044992117,3cyclictest885910-21kworker/u8:2+events_unbound20:10:172
834044992117,3cyclictest885910-21kworker/u8:2+events_unbound20:10:162
834044992117,3cyclictest1136301-21apt-get00:00:122
834044992117,3cyclictest1120162-21base6423:45:012
83404499210,19cyclictest1-21systemd20:35:012
834040992118,2cyclictest812828-21kworker/u8:0+flush-259:019:45:151
834040992117,3cyclictest885910-21kworker/u8:2+events_unbound20:22:151
834037992117,3cyclictest885910-21kworker/u8:2+flush-259:020:45:180
834037992112,3cyclictest335557-21systemd-journal00:07:460
834048992017,2cyclictest1167206-21kworker/u8:3+flush-259:000:30:263
834048992017,2cyclictest1120209-21kworker/u8:2+events_unbound00:20:143
83404899200,18cyclictest509-21rs:main3
834044992017,2cyclictest974151-21kworker/u8:3+flush-259:021:35:202
834044992016,3cyclictest958161-21kworker/u8:4+flush-259:022:57:572
834044992016,3cyclictest1062013-21kworker/u8:0+flush-259:023:10:102
834040992017,2cyclictest870475-21kworker/u8:3+events_unbound20:00:011
834040992017,2cyclictest1104670-21kworker/u8:3+events_unbound23:50:221
834040992016,3cyclictest1130576-21kworker/u8:1+events_unbound00:38:451
834040992016,3cyclictest1120209-21kworker/u8:2+flush-259:000:20:201
834037992016,3cyclictest916907-21kworker/u8:0+flush-259:020:55:210
834037992016,3cyclictest1109188-21apt-get23:35:000
834037992015,4cyclictest958161-21kworker/u8:4+flush-259:022:10:230
834037992014,4cyclictest886527-21/usr/sbin/munin20:00:130
834037992013,6cyclictest60350irq/132-enp0s29f1:rx-022:05:200
834037992012,1cyclictest61150irq/133-enp0s29f1:tx-000:00:180
834037992011,2cyclictest61150irq/133-enp0s29f1:tx-023:09:490
834037992010,2cyclictest60350irq/132-enp0s29f1:rx-023:10:120
834044991917,2cyclictest916907-21kworker/u8:0+events_unbound21:15:142
834044991916,2cyclictest885910-21kworker/u8:2+events_unbound20:20:202
834044991916,2cyclictest1167206-21kworker/u8:3+events_unbound00:30:432
834044991914,4cyclictest1145438-21ntpq00:05:212
834040991916,2cyclictest916907-21kworker/u8:0+events_unbound21:15:221
834040991916,2cyclictest1130576-21kworker/u8:1+flush-259:000:02:491
834040991916,2cyclictest1036095-21kworker/u8:0+events_unbound22:27:551
834037991914,3cyclictest1062013-21kworker/u8:0+flush-259:023:00:210
834037991913,4cyclictest885910-21kworker/u8:2+flush-259:021:10:150
834037991911,6cyclictest1045462-21ntpq22:30:210
834037991911,5cyclictest900846-21ntpq20:10:200
834037991911,5cyclictest900846-21ntpq20:10:190
834048991816,1cyclictest974151-21kworker/u8:3+flush-259:022:00:003
834048991814,3cyclictest891475-21kworker/u8:1+events_unbound20:09:563
834044991815,2cyclictest1062013-21kworker/u8:0+events_unbound23:01:492
834044991814,3cyclictest1167206-21kworker/u8:3+events_unbound00:35:302
834044991814,3cyclictest1093720-21kworker/u8:0+events_unbound23:46:382
834040991815,2cyclictest974151-21kworker/u8:3+flush-259:022:00:201
834040991815,2cyclictest1052165-21kworker/u8:2+flush-259:022:41:451
834040991814,3cyclictest812828-21kworker/u8:0+events_unbound20:01:441
834040991814,2cyclictest989387-21sh21:40:001
834037991814,3cyclictest1130576-21kworker/u8:1+flush-259:000:10:160
834037991813,4cyclictest60350irq/132-enp0s29f1:rx-000:30:170
834040991714,3cyclictest1167206-21kworker/u8:3+events_unbound00:28:501
834040991714,2cyclictest818324-21kworker/u8:4+flush-259:019:32:081
834040991713,3cyclictest916907-21kworker/u8:0+flush-259:020:40:111
834040991713,3cyclictest891475-21kworker/u8:1+events_unbound20:13:031
834040991713,3cyclictest891475-21kworker/u8:1+events_unbound20:13:021
834040991713,3cyclictest1062013-21kworker/u8:0+flush-259:022:47:501
83403799179,1cyclictest60350irq/132-enp0s29f1:rx-023:25:160
834037991714,2cyclictest60350irq/132-enp0s29f1:rx-023:35:260
834037991712,4cyclictest60350irq/132-enp0s29f1:rx-000:25:200
834037991712,3cyclictest916907-21kworker/u8:0+flush-259:021:05:150
834044991612,3cyclictest916907-21kworker/u8:0+events_unbound20:29:442
834040991613,2cyclictest812828-21kworker/u8:0+flush-259:019:25:191
834040991612,3cyclictest1120209-21kworker/u8:2+events_unbound00:17:531
834037991614,1cyclictest60350irq/132-enp0s29f1:rx-021:40:270
834037991613,2cyclictest60350irq/132-enp0s29f1:rx-022:49:360
834037991611,4cyclictest1157373-21apt-get00:20:120
834037991611,1cyclictest60350irq/132-enp0s29f1:rx-020:38:010
834037991610,4cyclictest989383-21apt-get21:40:000
834044991512,2cyclictest885910-21kworker/u8:2+flush-259:020:02:432
834044991511,3cyclictest839173-21kworker/u8:2+flush-259:019:15:272
834044991511,3cyclictest1120209-21kworker/u8:2+events_unbound00:26:412
834040991511,3cyclictest916907-21kworker/u8:0+events_unbound21:23:191
83403799159,4cyclictest1004336-21ntpq21:50:200
83403799158,5cyclictest1119984-21apt-get23:45:000
834037991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:180
834037991513,1cyclictest60350irq/132-enp0s29f1:rx-023:16:200
834037991513,1cyclictest60350irq/132-enp0s29f1:rx-022:19:400
834037991513,1cyclictest60350irq/132-enp0s29f1:rx-019:10:180
834037991512,2cyclictest61150irq/133-enp0s29f1:tx-019:35:200
834037991512,2cyclictest60350irq/132-enp0s29f1:rx-021:59:570
834037991512,2cyclictest60350irq/132-enp0s29f1:rx-020:16:140
834037991512,2cyclictest60350irq/132-enp0s29f1:rx-019:49:590
834037991410,3cyclictest953260-21sh21:05:010
834037991410,3cyclictest60350irq/132-enp0s29f1:rx-021:30:120
83403799139,3cyclictest1167206-21kworker/u8:3+flush-259:000:35:200
834037991311,1cyclictest60350irq/132-enp0s29f1:rx-019:55:240
834037991310,2cyclictest60350irq/132-enp0s29f1:rx-022:55:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional