You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-21 - 10:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4s.osadl.org (updated Sun Apr 21, 2024 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
872672994438,4cyclictest1129908-21latency_hist22:40:002
872672994138,2cyclictest1166903-21kworker/u8:0+flush-259:023:45:102
872672994138,2cyclictest1003310-21kworker/u8:4+events_unbound21:50:002
872666994037,2cyclictest1181059-21kworker/u8:2+flush-259:023:30:120
872666994037,2cyclictest1047709-21kworker/u8:0+flush-259:022:10:260
87267699381,35cyclictest1084642-21munin-run22:10:003
872672993835,2cyclictest1003310-21kworker/u8:4+flush-259:021:35:002
872676993728,5cyclictest990740-21latency_hist21:05:003
872672993734,2cyclictest74-21kswapd023:30:002
872672993732,3cyclictest74-21kswapd023:15:002
872676993532,2cyclictest1082441-21kworker/u8:4+flush-259:022:10:103
872676993430,3cyclictest1003310-21kworker/u8:4+events_unbound21:54:413
872670993431,2cyclictest1003310-21kworker/u8:4+flush-259:021:55:181
872670993329,2cyclictest74-21kswapd021:50:011
872670993328,3cyclictest1092259-21cat22:15:011
872666993328,4cyclictest1293105-21cat00:30:010
872676993229,2cyclictest1115172-21kworker/u8:3+events_unbound22:45:163
872670993226,4cyclictest1040702-21ssh21:40:141
872676993125,4cyclictest1233447-21latency_hist23:50:013
872666993027,2cyclictest1115172-21kworker/u8:3+events_unbound22:55:110
872672992825,2cyclictest1105676-21kworker/u8:2+events_unbound22:25:282
872666992825,2cyclictest939135-21kworker/u8:1+events_unbound20:50:020
872670992723,3cyclictest74-21kswapd000:24:591
872666992724,2cyclictest939135-21kworker/u8:1+flush-259:021:55:140
872676992623,2cyclictest1003310-21kworker/u8:4+events_unbound21:55:103
872676992522,2cyclictest939135-21kworker/u8:1+flush-259:020:50:193
872676992522,2cyclictest908623-21kworker/u8:3+flush-259:019:55:233
872676992521,3cyclictest893337-21apt-get19:30:133
872676992519,4cyclictest253-21systemd-journal19:46:513
872666992522,2cyclictest1166903-21kworker/u8:0+flush-259:023:19:560
872676992422,2cyclictest1092054-21kworker/u8:1+flush-259:022:20:213
872676992421,2cyclictest939135-21kworker/u8:1+events_unbound21:42:223
872676992421,2cyclictest928640-21kworker/u8:0+events_unbound20:20:193
872676992421,2cyclictest1092054-21kworker/u8:1+events_unbound22:15:193
872676992418,4cyclictest253-21systemd-journal00:04:593
872672992421,2cyclictest1195374-21kworker/u8:3+flush-259:023:35:222
872666992421,2cyclictest928640-21kworker/u8:0+events_unbound20:05:000
872676992320,2cyclictest498-21dbus-daemon00:00:003
872672992320,2cyclictest74-21kswapd021:45:002
872670992319,3cyclictest74-21kswapd000:05:001
872666992319,3cyclictest1055416-21apt-get21:50:120
872666992317,4cyclictest1025500-21latency_hist21:30:000
872676992219,2cyclictest908623-21kworker/u8:3+flush-259:020:25:193
872676992219,2cyclictest1115172-21kworker/u8:3+flush-259:023:10:213
872676992219,2cyclictest1115172-21kworker/u8:3+flush-259:022:55:193
872676992218,3cyclictest74-21kswapd000:14:593
872676992217,3cyclictest1033253-21/usr/sbin/munin21:35:193
872672992219,2cyclictest1226036-21kworker/u8:1+flush-259:000:00:232
872670992217,3cyclictest1010688-21latency_hist21:20:011
872666992219,2cyclictest954552-21kworker/u8:2+flush-259:020:35:010
872666992219,2cyclictest954552-21kworker/u8:2+events_unbound20:45:280
872666992218,3cyclictest74-21kswapd022:50:000
872676992118,2cyclictest954552-21kworker/u8:2+events_unbound20:35:173
872676992118,2cyclictest939135-21kworker/u8:1+flush-259:021:16:473
872676992118,2cyclictest1285062-21apt-get00:25:023
872676992118,2cyclictest1195374-21kworker/u8:3+flush-259:000:15:183
872676992118,2cyclictest1047709-21kworker/u8:0+events_unbound21:45:163
872676992114,5cyclictest882862-21latency_hist19:20:013
872672992118,2cyclictest1047709-21kworker/u8:0+flush-259:021:50:212
872670992118,2cyclictest954552-21kworker/u8:2+events_unbound20:45:211
872670992118,2cyclictest1082441-21kworker/u8:4+flush-259:022:20:201
872670992117,3cyclictest1128718-21ssh22:37:481
872666992118,2cyclictest954552-21kworker/u8:2+flush-259:020:40:160
872666992117,3cyclictest1082441-21kworker/u8:4+flush-259:022:19:560
872672992015,3cyclictest516-21rs:main2
872672992015,3cyclictest253-21systemd-journal22:52:512
872670992017,2cyclictest954552-21kworker/u8:2+events_unbound20:40:011
872670992017,2cyclictest1166903-21kworker/u8:0+flush-259:023:40:221
872670992015,4cyclictest1152398-21apt-get22:55:091
872666992016,3cyclictest1082441-21kworker/u8:4+events_unbound23:10:120
872666992016,3cyclictest1032893-21cron21:35:000
872666992014,4cyclictest1293566-21cp00:30:010
872676991916,2cyclictest74-21kswapd022:45:013
872676991916,2cyclictest1082441-21kworker/u8:4+events_unbound22:50:153
872676991915,3cyclictest939135-21kworker/u8:1+flush-259:021:10:153
872676991915,3cyclictest872570-21latency_hist19:10:013
872676991915,2cyclictest1167661-21irqcore23:05:173
872676991914,3cyclictest924027-21/usr/sbin/munin20:00:173
872672991916,2cyclictest1003310-21kworker/u8:4+flush-259:021:20:222
872672991914,4cyclictest1039018-21ssh21:37:342
872670991917,1cyclictest0-21swapper/123:10:011
872670991915,3cyclictest74-21kswapd022:45:091
872670991913,4cyclictest1018087-21latency_hist21:25:001
872666991916,2cyclictest939135-21kworker/u8:1+events_unbound20:55:240
872666991915,3cyclictest714600-21kworker/u8:0+flush-259:019:25:160
872666991913,4cyclictest1047684-21latency_hist21:45:000
872676991816,2cyclictest1195374-21kworker/u8:3+events_unbound23:40:213
872676991816,1cyclictest1082441-21kworker/u8:4+events_unbound22:33:243
872676991815,2cyclictest1166903-21kworker/u8:0+events_unbound23:52:413
872676991815,2cyclictest1115172-21kworker/u8:3+events_unbound23:00:253
872676991812,5cyclictest1189435-21apt-get23:20:133
872672991815,2cyclictest929567-21irqcore20:05:182
872672991815,2cyclictest74-21kswapd023:10:012
872672991815,2cyclictest74-21kswapd000:05:152
872672991815,2cyclictest1261285-21kworker/u8:0+events_unbound00:30:232
872672991815,2cyclictest1208373-21kworker/u8:1+flush-259:023:32:392
872672991815,2cyclictest1105676-21kworker/u8:2+flush-259:022:30:292
872672991815,2cyclictest1047709-21kworker/u8:0+flush-259:022:15:202
872672991814,3cyclictest1307512-21ssh00:38:462
872672991812,4cyclictest1241148-21ssh23:55:132
872670991815,2cyclictest74-21kswapd023:24:411
872670991815,2cyclictest1160878-21kthreadcore23:00:171
872670991814,3cyclictest1120936-21ssh22:32:011
872670991814,3cyclictest1039368-21ssh21:38:121
872666991815,2cyclictest954552-21kworker/u8:2+flush-259:020:40:000
872666991815,2cyclictest939135-21kworker/u8:1+events_unbound21:00:130
872666991815,2cyclictest1166903-21kworker/u8:0+flush-259:023:25:240
872666991815,2cyclictest1033171-21kworker/u8:3+events_unbound21:35:510
872666991814,3cyclictest1195374-21kworker/u8:3+events_unbound23:35:140
872666991814,3cyclictest1105676-21kworker/u8:2+events_unbound22:32:380
872666991814,2cyclictest1082441-21kworker/u8:4+flush-259:022:20:010
872666991813,2cyclictest61150irq/132-enp0s29f1:rx-023:43:270
872676991714,2cyclictest975381-21apt-key20:50:013
872676991714,2cyclictest1300227-21kworker/u8:1+events_unbound00:37:593
872676991713,3cyclictest954552-21kworker/u8:2+events_unbound21:05:133
872676991713,3cyclictest1285015-21kworker/u8:2+flush-259:000:30:543
872676991713,3cyclictest1195374-21kworker/u8:3+events_unbound23:32:043
872672991714,2cyclictest954552-21kworker/u8:2+events_unbound20:40:132
872672991714,2cyclictest939135-21kworker/u8:1+events_unbound21:10:172
872672991714,2cyclictest1181059-21kworker/u8:2+flush-259:023:16:012
872672991713,3cyclictest1166903-21kworker/u8:0+flush-259:023:41:562
872672991713,3cyclictest1076674-21ssh22:03:592
872672991713,3cyclictest1076674-21ssh22:03:592
872670991713,3cyclictest1098436-21ssh22:17:191
872666991715,2cyclictest877791-21kworker/u8:1+events_unbound19:45:230
872666991714,2cyclictest954552-21kworker/u8:2+events_unbound21:05:150
872666991714,2cyclictest908623-21kworker/u8:3+flush-259:020:20:000
872666991714,2cyclictest61150irq/132-enp0s29f1:rx-022:00:200
872666991714,2cyclictest61150irq/132-enp0s29f1:rx-022:00:190
872666991714,2cyclictest61150irq/132-enp0s29f1:rx-000:21:460
872666991714,2cyclictest1195374-21kworker/u8:3+flush-259:000:09:560
872666991714,2cyclictest1115172-21kworker/u8:3+events_unbound22:35:250
872666991714,2cyclictest0-21swapper/019:55:010
872666991713,2cyclictest61150irq/132-enp0s29f1:rx-023:20:210
872676991613,2cyclictest939135-21kworker/u8:1+flush-259:020:55:323
872676991613,2cyclictest928640-21kworker/u8:0+events_unbound20:10:033
872676991613,2cyclictest714600-21kworker/u8:0+events_unbound19:25:153
872676991613,2cyclictest1261285-21kworker/u8:0+flush-259:000:07:443
872676991613,2cyclictest1069884-21kworker/u8:2+flush-259:022:00:253
872676991613,2cyclictest1069884-21kworker/u8:2+flush-259:022:00:243
872676991612,3cyclictest1195374-21kworker/u8:3+flush-259:023:35:063
872676991612,3cyclictest1082441-21kworker/u8:4+events_unbound23:15:243
872676991611,3cyclictest898420-21/usr/sbin/munin19:35:133
872670991614,1cyclictest1218668-21sh23:40:011
872670991610,4cyclictest1203912-21latency_hist23:30:001
872666991614,1cyclictest61150irq/132-enp0s29f1:rx-021:49:380
872666991614,1cyclictest61150irq/132-enp0s29f1:rx-000:38:490
872666991614,1cyclictest61150irq/132-enp0s29f1:rx-000:10:110
872666991613,2cyclictest61950irq/133-enp0s29f1:tx-022:25:140
872666991613,2cyclictest61150irq/132-enp0s29f1:rx-023:50:400
872666991613,2cyclictest61150irq/132-enp0s29f1:rx-023:45:120
872666991613,2cyclictest61150irq/132-enp0s29f1:rx-022:54:060
872666991613,2cyclictest61150irq/132-enp0s29f1:rx-021:23:520
872666991613,2cyclictest61150irq/132-enp0s29f1:rx-000:15:470
872666991612,3cyclictest61150irq/132-enp0s29f1:rx-022:05:130
872676991512,2cyclictest491ktimers/321:25:153
872676991512,2cyclictest1082441-21kworker/u8:4+events_unbound22:35:073
872676991511,3cyclictest714600-21kworker/u8:0+flush-259:019:10:243
872676991511,3cyclictest1226036-21kworker/u8:1+events_unbound00:20:223
872676991511,3cyclictest1181059-21kworker/u8:2+flush-259:023:27:583
87267299150,13cyclictest1285062-21apt00:25:002
872670991512,2cyclictest311ktimers/122:54:341
872670991512,2cyclictest1181059-21kworker/u8:2+events_unbound23:15:001
872670991511,3cyclictest1023140-21ssh21:25:341
872670991510,3cyclictest1055389-21/usr/sbin/munin21:50:151
87266699159,4cyclictest253-21systemd-journal19:45:000
872666991513,2cyclictest61150irq/132-enp0s29f1:rx-019:32:050
872666991513,1cyclictest61150irq/132-enp0s29f1:rx-021:15:040
872666991513,1cyclictest61150irq/132-enp0s29f1:rx-021:13:220
872666991512,2cyclictest61150irq/132-enp0s29f1:rx-023:08:590
872666991512,2cyclictest61150irq/132-enp0s29f1:rx-000:02:150
872666991512,2cyclictest1226036-21kworker/u8:1+events_unbound23:55:210
872666991511,3cyclictest714600-21kworker/u8:0+events_unbound19:15:010
872666991511,2cyclictest61150irq/132-enp0s29f1:rx-020:10:110
872666991510,4cyclictest253-21systemd-journal19:25:000
872676991412,2cyclictest908623-21kworker/u8:3+events_unbound19:50:153
872676991411,2cyclictest954552-21kworker/u8:2+events_unbound21:23:593
872676991410,2cyclictest939135-21kworker/u8:1+events_unbound20:32:153
872672991412,1cyclictest0-21swapper/222:40:262
872672991411,2cyclictest975657-21apt-get20:50:112
872672991411,2cyclictest908623-21kworker/u8:3+flush-259:019:50:182
872672991411,2cyclictest1285015-21kworker/u8:2+events_unbound00:29:562
872672991411,2cyclictest1159894-21cpuspeed_turbos23:00:112
872672991411,2cyclictest1115172-21kworker/u8:3+flush-259:022:55:152
872672991411,2cyclictest1082441-21kworker/u8:4+flush-259:022:10:572
872672991410,3cyclictest1115172-21kworker/u8:3+events_unbound22:45:222
872672991410,3cyclictest1081692-21kworker/u8:3+events_unbound22:09:512
872672991410,2cyclictest0-21swapper/222:25:002
87267099149,3cyclictest714600-21kworker/u8:0+flush-259:019:25:191
87267099147,5cyclictest1032893-21cron21:35:001
872670991413,1cyclictest311ktimers/100:28:351
872670991411,2cyclictest1308191-21idleruntime-cro00:39:591
872670991411,2cyclictest1226036-21kworker/u8:1+flush-259:023:59:551
872670991410,3cyclictest1187629-21ssh23:17:171
872666991412,1cyclictest61150irq/132-enp0s29f1:rx-022:41:470
872666991411,2cyclictest61150irq/132-enp0s29f1:rx-020:25:150
87267699139,3cyclictest908623-21kworker/u8:3+events_unbound20:09:533
87267699138,3cyclictest903301-21kworker/u8:2+events_unbound19:40:173
87267299139,3cyclictest1269616-21ssh00:13:452
872672991311,2cyclictest1082441-21kworker/u8:4+flush-259:023:20:212
872672991310,2cyclictest954552-21kworker/u8:2+flush-259:020:45:252
872672991310,2cyclictest0-21swapper/219:30:002
87267099138,3cyclictest959649-21latency_hist20:35:011
87267099138,3cyclictest253-21systemd-journal20:05:001
872670991310,2cyclictest1205739-21kthreadcore23:30:191
872670991310,2cyclictest1128245-21kworker/u8:0+flush-259:022:40:151
872670991310,2cyclictest1070343-21cpuspeed_turbos22:00:141
872670991310,2cyclictest1070343-21cpuspeed_turbos22:00:131
872666991310,2cyclictest61150irq/132-enp0s29f1:rx-019:15:140
87267699129,2cyclictest939135-21kworker/u8:1+events_unbound20:42:163
87267299129,2cyclictest949748-21cpuspeed_turbos20:25:132
87267299129,2cyclictest939135-21kworker/u8:1+flush-259:021:25:282
87267299129,2cyclictest714600-21kworker/u8:0+events_unbound19:20:152
87267299129,2cyclictest1234868-21kthreadcore23:50:192
87267299128,3cyclictest1195374-21kworker/u8:3+events_unbound00:15:222
87267299128,3cyclictest1010427-21ssh21:19:312
87267299127,3cyclictest985364-21sshd20:57:172
87267299126,4cyclictest10678821ssh21:56:202
87267299120,1cyclictest964750-21basename20:40:012
87267099129,2cyclictest939135-21kworker/u8:1+events_unbound22:05:191
87267099129,2cyclictest1271891-21kthreadcore00:15:181
87267099129,2cyclictest1166903-21kworker/u8:0+flush-259:023:45:231
87267099129,1cyclictest0-21swapper/120:30:001
87266699129,2cyclictest908623-21kworker/u8:3+events_unbound19:55:120
872666991211,1cyclictest61150irq/132-enp0s29f1:rx-019:35:240
872666991210,2cyclictest61150irq/132-enp0s29f1:rx-020:20:240
87267699111,8cyclictest887951-21latency_hist19:25:013
87267299119,1cyclictest948680-21sensors20:20:252
87267299119,1cyclictest0-21swapper/219:40:272
87267299118,2cyclictest877791-21kworker/u8:1+events_unbound20:00:242
87267299117,3cyclictest714600-21kworker/u8:0+events_unbound19:35:182
87267299115,4cyclictest253-21systemd-journal21:10:002
87267099119,1cyclictest311ktimers/122:25:221
87267099118,2cyclictest928640-21kworker/u8:0+flush-259:020:25:021
87267099118,2cyclictest928640-21kworker/u8:0+flush-259:020:05:171
87267099112,3cyclictest1003296-21idleruntime-cro21:14:591
87267699101,6cyclictest944245-21idleruntime-cro20:20:003
87267299108,1cyclictest877058-21sensors19:10:292
87267299107,2cyclictest908623-21kworker/u8:3+flush-259:019:55:212
87267299107,2cyclictest0-21swapper/219:50:002
87267299106,2cyclictest9395252sleep220:15:162
87267099108,1cyclictest985841-21/usr/sbin/munin21:00:161
87267099108,1cyclictest923070-21sensors19:55:221
87267099108,1cyclictest877791-21kworker/u8:1+flush-259:019:45:261
87267099108,1cyclictest842-21snmpd20:19:581
87267099108,1cyclictest311ktimers/121:05:051
87267099108,1cyclictest311ktimers/119:14:471
87267099108,1cyclictest0-21swapper/100:30:201
87267099107,2cyclictest883124-21apt-get19:20:101
87267099107,2cyclictest877791-21kworker/u8:1+flush-259:019:34:561
87267099107,2cyclictest1263426-21cpuspeed_turbos00:10:141
87267099107,2cyclictest0-21swapper/120:10:191
87266699108,1cyclictest61150irq/132-enp0s29f1:rx-020:05:140
8726729998,1cyclictest892702-21kworker/2:0+events_power_efficient21:00:032
8726729998,1cyclictest892702-21kworker/2:0+events_power_efficient20:10:152
8726729998,1cyclictest892702-21kworker/2:0+events_power_efficient19:30:032
8726729998,1cyclictest872293-21kworker/2:1+events_power_efficient19:15:072
8726709998,1cyclictest311ktimers/100:05:021
8726709997,1cyclictest882146-21sensors19:15:261
8726709997,1cyclictest311ktimers/119:54:541
8726709997,1cyclictest0-21swapper/120:40:111
8726709996,2cyclictest0-21swapper/119:40:221
8726709993,1cyclictest903277-21apt19:40:001
8726709975,1cyclictest0-21swapper/120:55:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional