You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-06 - 11:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-4360 CPU @3700 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of shadow in rack #0, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot7s.osadl.org (updated Tue Jun 06, 2023 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1250969212061,21sleep30-21swapper/319:05:423
1251249211871,20sleep20-21swapper/219:09:182
1251098210364,16sleep10-21swapper/119:07:201
1250949210170,19sleep00-21swapper/019:05:270
1251472996662,4cyclictest1434987-21kworker/2:023:51:372
1251472996564,1cyclictest1283240-21kworker/2:221:31:402
1251472996463,1cyclictest1440638-21kworker/2:100:00:292
1251472996463,1cyclictest1412857-21kworker/2:223:29:452
1251472996463,1cyclictest1397593-21kworker/2:223:06:332
1251472996463,1cyclictest1360001-21kworker/2:022:39:142
1251472996463,1cyclictest1355791-21kworker/2:222:20:072
1251472996463,1cyclictest1355791-21kworker/2:222:15:522
1251472996463,1cyclictest1350753-21kworker/2:122:12:062
1251472996463,1cyclictest1321974-21kworker/2:121:35:452
1251472996463,1cyclictest1283240-21kworker/2:221:54:522
1251472996463,1cyclictest1283240-21kworker/2:221:24:492
1251472996463,1cyclictest1268661-21kworker/2:019:57:272
1251472996460,4cyclictest1440638-21kworker/2:100:11:142
1251472996460,4cyclictest1440638-21kworker/2:100:07:092
125147699630,63cyclictest0-21swapper/323:05:493
1251472996362,1cyclictest1462919-21kworker/2:100:32:342
1251472996362,1cyclictest1462919-21kworker/2:100:28:592
1251472996362,1cyclictest1458691-21kworker/2:200:20:572
1251472996362,1cyclictest1454230-21kworker/2:000:15:302
1251472996362,1cyclictest1412857-21kworker/2:223:45:072
1251472996362,1cyclictest1412857-21kworker/2:223:42:232
1251472996362,1cyclictest1412857-21kworker/2:223:30:472
1251472996362,1cyclictest1403524-21kworker/2:023:15:462
1251472996362,1cyclictest1383915-21kworker/2:123:00:242
1251472996362,1cyclictest1383915-21kworker/2:122:55:272
1251472996362,1cyclictest1360001-21kworker/2:022:33:172
1251472996362,1cyclictest1346249-21kworker/2:022:07:292
1251472996362,1cyclictest1283240-21kworker/2:222:03:252
1251472996362,1cyclictest1283240-21kworker/2:221:42:042
1251472996362,1cyclictest1283240-21kworker/2:221:00:162
1251472996362,1cyclictest1251349-21kworker/2:119:19:442
125147299630,0cyclictest0-21swapper/221:18:592
125146799630,63cyclictest0-21swapper/123:10:581
125147699620,62cyclictest0-21swapper/322:20:253
1251472996261,1cyclictest1462919-21kworker/2:100:35:072
1251472996261,1cyclictest1440638-21kworker/2:123:57:242
1251472996261,1cyclictest1412857-21kworker/2:223:36:452
1251472996261,1cyclictest1397593-21kworker/2:223:12:002
1251472996261,1cyclictest1383915-21kworker/2:122:51:012
1251472996261,1cyclictest1283240-21kworker/2:221:46:102
1251472996261,1cyclictest1283240-21kworker/2:221:12:422
1251472996261,1cyclictest1283240-21kworker/2:220:47:582
1251472996261,1cyclictest1283240-21kworker/2:220:35:202
1251472996260,1cyclictest2366-21gnome-shell20:43:592
125146799620,61cyclictest0-21swapper/119:45:261
125146799620,1cyclictest0-21swapper/121:28:581
1251476996157,3cyclictest2366-21gnome-shell00:24:593
1251472996160,1cyclictest1360001-21kworker/2:022:45:032
1251472996160,1cyclictest1360001-21kworker/2:022:27:582
1251472996160,1cyclictest1283240-21kworker/2:221:56:542
1251472996160,1cyclictest1283240-21kworker/2:221:26:212
1251472996160,1cyclictest1268661-21kworker/2:020:11:172
1251472996160,1cyclictest1268661-21kworker/2:020:07:412
1251472996160,1cyclictest1251349-21kworker/2:119:33:342
1251472996160,1cyclictest1251349-21kworker/2:119:28:472
1251472996160,1cyclictest1251349-21kworker/2:119:10:212
1251476996057,3cyclictest1042-21snmpd21:50:333
1251476996057,2cyclictest0-21swapper/322:35:253
1251472996059,1cyclictest1360001-21kworker/2:022:40:592
1251472996059,1cyclictest1283240-21kworker/2:221:07:042
1251472996059,1cyclictest1283240-21kworker/2:220:34:502
1251472996059,1cyclictest1283240-21kworker/2:220:26:492
1251472996059,1cyclictest1268661-21kworker/2:020:23:332
1251472996059,1cyclictest1268661-21kworker/2:019:51:182
1251472996059,1cyclictest1251349-21kworker/2:119:46:222
1251472996059,1cyclictest1251349-21kworker/2:119:42:262
1251472996059,1cyclictest1251349-21kworker/2:119:36:172
1251472996059,1cyclictest1251349-21kworker/2:119:22:382
1251467996058,1cyclictest2366-21gnome-shell22:39:581
1251467996058,1cyclictest2366-21gnome-shell20:21:581
1251476995955,3cyclictest2366-21gnome-shell20:23:583
1251476995955,3cyclictest0-21swapper/320:40:223
1251472995958,1cyclictest1403524-21kworker/2:023:20:322
1251472995958,1cyclictest1283240-21kworker/2:220:58:032
1251476995857,1cyclictest1453860-21ssh00:11:063
1251476995854,3cyclictest2366-21gnome-shell20:28:593
1251472995857,1cyclictest1283240-21kworker/2:220:50:312
1251472995857,1cyclictest1268661-21kworker/2:020:16:032
1251472995857,1cyclictest1268661-21kworker/2:020:03:362
1251467995856,1cyclictest2366-21gnome-shell19:26:591
1251463995855,2cyclictest2366-21gnome-shell21:41:580
1251463995855,2cyclictest2366-21gnome-shell21:37:590
1251476995756,1cyclictest1440715-21sensors23:55:293
1251476995754,3cyclictest0-21swapper/321:05:583
1251467995756,1cyclictest1272107-21sensors19:55:231
1251463995756,1cyclictest0-21swapper/022:32:580
1251476995655,1cyclictest1311834-21sensors21:20:263
1251476995652,3cyclictest2366-21gnome-shell23:36:583
1251467995655,1cyclictest0-21swapper/122:01:591
1251467995655,1cyclictest0-21swapper/121:30:591
125146799560,5cyclictest0-21swapper/120:26:591
125146799560,1cyclictest0-21swapper/122:05:581
1251476995553,1cyclictest1292929-21sensors20:45:263
1251467995554,1cyclictest1340923-21sensors21:55:261
1251476995453,1cyclictest0-21swapper/322:00:353
1251467995453,1cyclictest1449047-21sensors00:05:271
1251467995453,1cyclictest1390799-21sensors22:55:271
1251467995453,1cyclictest1042-21snmpd23:15:501
1251467995453,1cyclictest0-21swapper/123:21:591
1251467995452,1cyclictest2366-21gnome-shell20:19:591
1251467995451,2cyclictest2366-21gnome-shell23:08:591
1251463995453,1cyclictest1042-21snmpd19:15:040
1251476995352,1cyclictest1042-21snmpd20:55:233
1251476995348,4cyclictest2366-21gnome-shell19:15:593
1251467995352,1cyclictest0-21swapper/119:35:281
1251467995351,1cyclictest2366-21gnome-shell19:22:591
1251463995352,1cyclictest1407425-21sensors23:15:260
1251463995351,1cyclictest2366-21gnome-shell00:34:580
1251476995251,1cyclictest1299169-21sensors21:00:233
1251476995250,1cyclictest1274183-21sensors20:00:233
1251476995248,3cyclictest2366-21gnome-shell20:16:593
1251476995248,3cyclictest2366-21gnome-shell19:53:593
1251467995251,1cyclictest2366-21gnome-shell20:47:591
1251476995148,3cyclictest1419909-21sensors23:30:273
1251467995150,1cyclictest1288761-21sensors20:35:201
1251467995150,1cyclictest0-21swapper/123:32:581
1251463995150,1cyclictest0-21swapper/022:57:580
1251463995149,1cyclictest1042-21snmpd20:10:150
1251463995049,1cyclictest1353445-21sensors22:10:300
1251463995049,1cyclictest0-21swapper/023:01:580
1251476994946,3cyclictest0-21swapper/323:45:253
1251463994948,1cyclictest1274181-21sensors20:00:230
1251463994947,1cyclictest1411600-21ssh23:20:290
1251476994847,1cyclictest0-21swapper/322:40:333
1251476994847,1cyclictest0-21swapper/319:30:243
1251467994847,1cyclictest0-21swapper/100:00:281
1251463994847,1cyclictest1320161-21sensors21:30:280
1251463994847,1cyclictest0-21swapper/021:53:590
1251463994847,1cyclictest0-21swapper/021:24:590
1251463994746,1cyclictest1340917-21sensors21:55:260
1251476994645,1cyclictest0-21swapper/322:10:303
1251467994645,1cyclictest0-21swapper/121:20:291
1251476994542,3cyclictest1042-21snmpd00:31:103
1251476994542,3cyclictest0-21swapper/319:41:593
1251476994540,4cyclictest2366-21gnome-shell20:38:583
1251467994544,0cyclictest0-21swapper/122:20:001
1251463994544,1cyclictest1280439-21sensors20:15:210
1251463994544,1cyclictest0-21swapper/023:55:580
1251463994443,1cyclictest0-21swapper/021:18:590
1251463994442,1cyclictest2366-21gnome-shell22:18:580
1251476994338,4cyclictest2366-21gnome-shell19:21:593
1251463994341,1cyclictest2366-21gnome-shell23:11:580
1251476994241,1cyclictest0-21swapper/323:25:523
1251467994241,1cyclictest1370059-21sensors22:30:321
1251467994241,1cyclictest0-21swapper/123:55:291
1251467994240,1cyclictest0-21swapper/121:44:591
1251463994241,1cyclictest0-21swapper/022:50:460
1251476994140,1cyclictest1465684-21sensors00:25:273
1251476994137,3cyclictest2366-21gnome-shell20:53:583
1251467994140,1cyclictest1471674-21kworker/1:000:36:591
1251467994140,1cyclictest1453569-21kworker/1:200:16:591
1251463994140,1cyclictest1267942-21sensors19:45:250
1251463994140,1cyclictest1259621-21sensors19:25:260
1251467994040,0cyclictest1325904-21ssh21:37:591
1251467994039,1cyclictest1362295-21kworker/1:222:25:591
1251463994039,1cyclictest0-21swapper/000:09:520
1251463994037,2cyclictest2366-21gnome-shell00:13:580
1251476993936,2cyclictest0-21swapper/319:28:593
1251467993938,1cyclictest1433551-21kworker/1:000:10:591
1251467993938,1cyclictest1429141-21kworker/1:223:52:001
1251467993938,1cyclictest1391569-21kworker/1:123:00:591
1251467993938,1cyclictest1293644-21kworker/1:021:10:581
1251476993836,2cyclictest0-21swapper/323:20:583
1251467993838,0cyclictest0-21swapper/121:47:001
1251467993837,1cyclictest1410246-21kworker/1:123:42:591
1251463993837,1cyclictest0-21swapper/021:45:290
1251467993736,1cyclictest1366771-21kworker/1:022:53:001
1251476993634,1cyclictest1042-21snmpd22:25:403
1251476993632,3cyclictest2366-21gnome-shell20:05:583
1251467993636,0cyclictest0-21swapper/122:12:591
1251467993635,1cyclictest1453569-21kworker/1:200:28:591
1251467993635,1cyclictest1415732-21kworker/1:023:27:591
1251467993635,1cyclictest0-21swapper/122:20:251
1251463993634,2cyclictest1301259-21sensors21:05:220
1251463993634,1cyclictest2366-21gnome-shell22:47:580
1251476993534,1cyclictest0-21swapper/323:40:273
1251476993534,1cyclictest0-21swapper/323:10:493
1251476993532,3cyclictest0-21swapper/320:10:593
1251476993530,4cyclictest2366-21gnome-shell20:30:593
1251467993535,0cyclictest0-21swapper/121:53:591
1251467993534,1cyclictest1466745-21kworker/1:100:30:591
1251467993534,1cyclictest1453569-21kworker/1:200:20:591
1251467993534,1cyclictest1299167-21sensors21:00:231
1251467993534,1cyclictest1281161-21kworker/1:220:42:591
1251467993534,1cyclictest1224266-21kworker/1:119:54:581
1251467993534,1cyclictest1224266-21kworker/1:119:10:591
1251463993534,1cyclictest0-21swapper/021:11:580
1251476993432,2cyclictest0-21swapper/319:39:593
1251467993434,0cyclictest1281161-21kworker/1:220:30:591
1251467993433,1cyclictest1410246-21kworker/1:123:39:001
1251467993433,1cyclictest1293644-21kworker/1:020:59:581
1251467993433,1cyclictest1224266-21kworker/1:120:12:591
1251467993433,1cyclictest1224266-21kworker/1:120:07:581
1251467993433,1cyclictest1042-21snmpd21:15:281
1251467993332,1cyclictest1381895-21kworker/1:122:49:591
1251467993332,1cyclictest1293644-21kworker/1:021:08:591
1251463993332,1cyclictest2366-21gnome-shell22:42:580
1251467993232,0cyclictest1224266-21kworker/1:119:40:591
1251467993231,1cyclictest1224266-21kworker/1:120:03:591
1251467993231,1cyclictest1224266-21kworker/1:119:19:591
1251463993129,1cyclictest2366-21gnome-shell00:36:580
1251463993029,1cyclictest0-21swapper/022:27:580
1251467992928,1cyclictest1224266-21kworker/1:119:31:591
125146399299,20cyclictest0-21swapper/023:50:400
1251476992827,1cyclictest1042-21snmpd00:06:063
1251463992826,1cyclictest2366-21gnome-shell23:05:590
1251476992726,1cyclictest0-21swapper/321:15:243
1251463992726,1cyclictest0-21swapper/023:45:580
1251463992724,2cyclictest2366-21gnome-shell23:38:590
1251463992724,2cyclictest2366-21gnome-shell00:26:580
1251476992625,1cyclictest1042-21snmpd21:55:343
1251463992625,1cyclictest0-21swapper/022:00:370
1251463992522,2cyclictest2366-21gnome-shell22:37:590
1251476992423,1cyclictest1370045-21ssh22:30:323
160599230,2ntpd14-21ksoftirqd/023:25:010
1251476992322,1cyclictest0-21swapper/300:35:473
125147699230,15cyclictest0-21swapper/321:49:203
1251463992322,1cyclictest0-21swapper/022:05:310
1251476992221,1cyclictest1444875-21sensors00:00:283
1251476992221,1cyclictest0-21swapper/321:10:233
1251463992221,1cyclictest2366-21gnome-shell00:16:580
1251463992220,1cyclictest2366-21gnome-shell23:43:580
1251463992219,2cyclictest2366-21gnome-shell21:25:580
125147699210,4cyclictest0-21swapper/319:55:013
1251463992119,2cyclictest2366-21gnome-shell22:20:590
125146399210,12cyclictest1301965-21diskmemload23:30:050
125147699200,16cyclictest0-21swapper/322:07:413
1251476991918,1cyclictest1457336-21ssh00:15:253
1251463991917,1cyclictest2366-21gnome-shell00:20:580
125147699170,16cyclictest0-21swapper/321:40:113
1251463991716,1cyclictest1042-21snmpd19:40:100
1251463991715,1cyclictest1042-21snmpd20:45:180
1251463991713,1cyclictest0-21swapper/019:13:560
125146399170,17cyclictest0-21swapper/020:59:530
125146399170,17cyclictest0-21swapper/000:01:000
125146399170,16cyclictest0-21swapper/019:34:120
1251476991615,1cyclictest0-21swapper/319:10:213
125147699160,7cyclictest0-21swapper/321:37:403
125147699160,16cyclictest0-21swapper/321:26:433
125146799165,1cyclictest0-21swapper/120:51:141
1251467991613,2cyclictest1042-21snmpd22:41:241
1251463991614,1cyclictest2366-21gnome-shell20:44:580
125146399160,16cyclictest0-21swapper/020:28:220
125147699150,7cyclictest0-21swapper/322:57:153
125147699150,6cyclictest0-21swapper/319:48:493
125146399150,7cyclictest0-21swapper/020:35:590
125146399150,6cyclictest0-21swapper/020:32:050
242099120,2rtkit-daemon2419-21rtkit-daemon19:56:470
125147699129,2cyclictest1042-21snmpd22:54:243
125147699129,2cyclictest1042-21snmpd22:19:033
125147699122,10cyclictest0-21swapper/323:19:313
1251476991211,1cyclictest0-21swapper/321:30:293
1251467991210,2cyclictest1042-21snmpd23:47:201
125146399129,2cyclictest1042-21snmpd20:20:200
1251463991211,1cyclictest0-21swapper/020:05:180
160599110,1ntpd40-21ksoftirqd/322:46:233
125146399119,1cyclictest557037-21nmbd21:02:290
125146399119,1cyclictest1042-21snmpd19:50:450
125146399119,1cyclictest1042-21snmpd19:35:440
1251463991110,1cyclictest1042-21snmpd19:22:010
125147699107,2cyclictest557037-21nmbd23:00:013
125146399108,2cyclictest557037-21nmbd20:52:110
12514769995,1cyclictest0-21swapper/323:54:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional