You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-04 - 04:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-4360 CPU @3700 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of shadow in rack #0, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack0slot7s.osadl.org (updated Sat Feb 04, 2023 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1570860212172,19sleep20-21swapper/219:06:542
1570887211571,18sleep30-21swapper/319:07:153
1570805211487,21sleep10-21swapper/119:06:131
1570761210170,19sleep00-21swapper/019:05:400
1571258996661,4cyclictest2366-21gnome-shell22:46:590
1571258996461,3cyclictest1612819-21sensors20:45:200
157125899640,1cyclictest0-21swapper/023:35:210
1571268996361,1cyclictest2366-21gnome-shell19:15:583
1571265996362,1cyclictest1723294-21sensors23:10:212
1571260996361,1cyclictest2366-21gnome-shell22:28:591
157126099630,63cyclictest0-21swapper/121:10:211
1571268996261,1cyclictest1577343-21sensors19:20:223
1571258996258,3cyclictest2366-21gnome-shell23:53:580
1571258996258,3cyclictest2366-21gnome-shell20:30:580
1571265996160,1cyclictest1791834-21kworker/2:000:37:532
1571265996157,4cyclictest1762346-21kworker/2:200:00:212
157126099610,61cyclictest0-21swapper/120:20:201
157125899610,1cyclictest0-21swapper/023:05:240
1571265996059,1cyclictest1771293-21kworker/2:100:11:372
1571265996059,1cyclictest1751973-21kworker/2:123:55:142
1571265996059,1cyclictest1610736-21sensors20:40:222
1571265996059,1cyclictest0-21swapper/200:31:592
1571260996058,1cyclictest2366-21gnome-shell19:54:581
1571260996058,1cyclictest0-21swapper/121:29:591
1571268995958,1cyclictest1623428-21sensors21:10:213
1571268995956,2cyclictest2366-21gnome-shell20:37:583
1571260995957,1cyclictest2366-21gnome-shell20:51:581
1571258995955,3cyclictest2366-21gnome-shell20:20:580
1571268995857,1cyclictest1756554-21sensors23:50:243
1571265995857,1cyclictest1723299-21kworker/2:123:25:522
1571265995857,1cyclictest1661402-21kworker/2:122:01:542
1571265995857,1cyclictest1661402-21kworker/2:121:59:512
1571265995857,1cyclictest1637667-21kworker/2:221:29:082
1571265995857,1cyclictest1578071-21kworker/2:019:30:012
1571265995854,4cyclictest1617735-21kworker/2:221:11:022
157126099580,58cyclictest0-21swapper/120:25:221
1571258995855,2cyclictest2366-21gnome-shell00:35:580
1571258995854,3cyclictest2366-21gnome-shell20:38:580
1571268995756,1cyclictest1733797-21kworker/3:123:42:593
1571268995756,1cyclictest1602388-21sensors20:20:203
1571268995756,1cyclictest0-21swapper/322:28:593
1571268995755,1cyclictest2366-21gnome-shell20:07:583
1571265995756,1cyclictest1694534-21kworker/2:022:40:282
1571265995756,1cyclictest1651039-21kworker/2:021:54:442
1571265995756,1cyclictest1594771-21kworker/2:020:06:522
1571265995756,1cyclictest0-21swapper/223:05:242
1571260995755,1cyclictest2366-21gnome-shell20:32:581
1571260995755,1cyclictest2366-21gnome-shell19:19:581
1571258995756,1cyclictest1723296-21sensors23:10:210
1571258995755,2cyclictest0-21swapper/020:04:580
1571258995754,3cyclictest1764878-21sensors00:00:250
1571268995654,1cyclictest2366-21gnome-shell20:40:583
1571265995654,1cyclictest1670428-21kworker/2:022:15:132
1571265995653,3cyclictest1741969-21kworker/2:223:36:272
1571260995655,1cyclictest1042-21snmpd20:04:471
1571260995655,1cyclictest0-21swapper/123:29:591
1571260995655,1cyclictest0-21swapper/119:55:211
1571260995655,1cyclictest0-21swapper/119:55:201
1571260995655,1cyclictest0-21swapper/119:45:221
1571258995655,1cyclictest1714992-21sensors23:00:220
1571258995654,2cyclictest0-21swapper/019:44:580
1571258995654,2cyclictest0-21swapper/019:30:590
1571268995554,1cyclictest1604479-21sensors20:25:213
1571268995553,1cyclictest2366-21gnome-shell19:31:583
1571265995554,1cyclictest1723299-21kworker/2:123:20:452
1571265995554,1cyclictest1606559-21sensors20:30:222
1571265995551,4cyclictest1684028-21kworker/2:222:37:032
1571265995551,4cyclictest1646492-21kworker/2:121:45:512
1571260995554,1cyclictest2366-21gnome-shell00:26:591
1571260995554,1cyclictest1761531-21kworker/1:100:10:591
1571260995554,1cyclictest1679578-21kworker/1:122:21:591
1571260995554,1cyclictest1661514-21ssh21:55:591
1571258995553,2cyclictest0-21swapper/019:24:580
1571268995453,1cyclictest0-21swapper/319:54:583
1571265995453,1cyclictest1741969-21kworker/2:223:49:242
1571265995453,1cyclictest1694534-21kworker/2:022:54:282
1571265995453,1cyclictest1594771-21kworker/2:020:23:562
1571265995453,1cyclictest1569053-21kworker/2:119:15:402
1571265995453,1cyclictest1042-21snmpd22:45:152
1571265995452,1cyclictest2366-21gnome-shell19:20:582
1571260995454,0cyclictest1754017-21ssh23:47:591
1571260995453,1cyclictest1733210-21kworker/1:123:36:581
1571260995453,1cyclictest0-21swapper/119:13:591
1571258995450,3cyclictest2366-21gnome-shell19:58:590
1571258995450,3cyclictest2366-21gnome-shell19:58:580
1571268995352,1cyclictest1623838-21kworker/3:221:29:593
1571268995352,1cyclictest0-21swapper/320:51:583
1571265995352,1cyclictest1782196-21kworker/2:100:28:412
1571265995352,1cyclictest1708797-21kworker/2:222:57:322
1571265995352,1cyclictest1684028-21kworker/2:222:30:232
1571265995349,4cyclictest1637667-21kworker/2:221:33:142
1571260995353,0cyclictest0-21swapper/121:42:591
1571260995353,0cyclictest0-21swapper/121:37:591
1571260995352,1cyclictest1688282-21kworker/1:023:18:581
1571260995352,1cyclictest1674721-21kworker/1:222:12:591
1571260995352,1cyclictest1665994-21kworker/1:022:17:581
1571260995352,1cyclictest0-21swapper/123:40:591
1571258995351,2cyclictest0-21swapper/020:06:580
1571258995349,3cyclictest2366-21gnome-shell21:04:580
1571265995251,1cyclictest1751973-21kworker/2:123:50:262
1571265995251,1cyclictest1646492-21kworker/2:121:40:242
1571265995251,1cyclictest0-21swapper/222:24:592
1571265995250,1cyclictest1684028-21kworker/2:222:25:172
1571265995248,4cyclictest1766726-21kworker/2:000:08:312
1571260995252,0cyclictest0-21swapper/120:44:551
1571260995251,1cyclictest1761531-21kworker/1:100:07:581
1571260995251,1cyclictest1688282-21kworker/1:022:42:591
1571260995251,1cyclictest1642077-21kworker/1:121:49:591
1571260995251,1cyclictest1562774-21kworker/1:019:28:001
1571260995251,1cyclictest0-21swapper/123:34:591
1571260995251,1cyclictest0-21swapper/120:59:581
1571260995251,1cyclictest0-21swapper/120:15:211
1571260995250,2cyclictest26-21ksoftirqd/123:13:591
1571258995251,1cyclictest1610732-21sensors20:40:210
1571268995150,1cyclictest1733797-21kworker/3:123:29:593
1571268995150,1cyclictest0-21swapper/320:04:473
1571268995150,1cyclictest0-21swapper/319:56:593
1571268995150,1cyclictest0-21swapper/319:56:583
1571265995150,1cyclictest1766726-21kworker/2:000:21:402
1571265995150,1cyclictest1670428-21kworker/2:022:10:462
1571265995150,1cyclictest1598220-21sensors20:10:252
1571260995150,1cyclictest1688282-21kworker/1:023:21:591
1571260995150,1cyclictest1688282-21kworker/1:022:45:581
1571260995150,1cyclictest1665994-21kworker/1:022:09:591
1571260995150,1cyclictest1656473-21kworker/1:221:51:591
1571260995150,1cyclictest0-21swapper/121:21:591
1571260995150,1cyclictest0-21swapper/121:18:591
1571260995150,1cyclictest0-21swapper/120:36:591
1571260995150,1cyclictest0-21swapper/120:13:001
1571260995150,1cyclictest0-21swapper/119:41:591
1571260995150,1cyclictest0-21swapper/100:36:591
1571258995150,1cyclictest0-21swapper/023:40:230
1571258995150,1cyclictest0-21swapper/022:26:590
1571258995147,3cyclictest2366-21gnome-shell19:18:580
1571268995049,1cyclictest1752835-21kworker/3:023:47:583
1571268995049,1cyclictest1657464-21kworker/3:021:59:593
1571268995049,1cyclictest1587777-21sensors19:45:213
1571268995049,1cyclictest0-21swapper/320:32:583
1571268995049,1cyclictest0-21swapper/300:26:593
1571268995049,1cyclictest0-21swapper/300:11:593
1571268995048,1cyclictest2366-21gnome-shell19:13:593
1571265995049,1cyclictest1746746-21kworker/2:023:40:532
1571265995049,1cyclictest1723299-21kworker/2:123:30:172
1571265995049,1cyclictest1632753-21kworker/2:121:22:592
1571265995049,1cyclictest1578071-21kworker/2:019:30:412
1571260995049,1cyclictest1580118-21kworker/1:219:36:591
1571260995049,1cyclictest0-21swapper/121:34:591
1571260995049,1cyclictest0-21swapper/120:08:591
1571260995049,1cyclictest0-21swapper/100:23:591
1571260995049,0cyclictest0-21swapper/123:55:591
1571258995049,1cyclictest0-21swapper/021:48:580
1571258995049,1cyclictest0-21swapper/021:30:210
1571268994949,0cyclictest1621901-21diskmemload22:21:593
1571268994948,1cyclictest391rcuc/323:36:593
1571265994948,1cyclictest1694534-21kworker/2:023:04:002
1571265994948,1cyclictest1637667-21kworker/2:221:38:212
1571265994948,1cyclictest1617735-21kworker/2:221:15:082
1571265994948,1cyclictest1617735-21kworker/2:221:05:142
1571260994949,0cyclictest0-21swapper/123:50:581
1571260994948,1cyclictest1761531-21kworker/1:100:17:591
1571260994948,1cyclictest1761531-21kworker/1:100:02:591
1571260994948,1cyclictest1688282-21kworker/1:022:32:581
1571260994948,1cyclictest1580118-21kworker/1:219:30:591
1571258994948,1cyclictest1621187-21sensors21:05:210
1571258994945,3cyclictest2366-21gnome-shell20:28:580
1571268994847,1cyclictest1679157-21ssh22:17:593
1571268994847,1cyclictest1636865-21kworker/3:121:42:593
1571268994847,1cyclictest1636865-21kworker/3:121:37:593
1571265994847,1cyclictest1766726-21kworker/2:000:16:232
1571265994847,1cyclictest1723299-21kworker/2:123:17:192
1571260994848,0cyclictest0-21swapper/121:06:591
1571260994847,1cyclictest1562774-21kworker/1:019:20:591
1571268994747,0cyclictest0-21swapper/322:12:593
1571268994746,1cyclictest1733797-21kworker/3:123:34:583
1571268994746,1cyclictest1623838-21kworker/3:221:19:593
1571268994746,1cyclictest1600304-21sensors20:15:213
1571268994746,1cyclictest0-21swapper/319:28:003
1571265994746,1cyclictest1590590-21kworker/2:219:55:162
1571265994746,1cyclictest1590590-21kworker/2:219:55:162
1571265994743,4cyclictest1661402-21kworker/2:122:06:002
1571268994646,0cyclictest0-21swapper/323:18:583
1571268994646,0cyclictest0-21swapper/322:42:593
1571268994645,1cyclictest2366-21gnome-shell20:59:593
1571268994645,1cyclictest1623838-21kworker/3:221:21:593
1571268994645,1cyclictest1573046-21kworker/3:219:42:003
1571268994645,1cyclictest0-21swapper/322:45:593
1571268994645,1cyclictest0-21swapper/322:09:593
1571268994645,1cyclictest0-21swapper/321:48:593
1571265994645,1cyclictest0-21swapper/219:48:582
1571258994645,1cyclictest0-21swapper/021:35:220
1571258994644,1cyclictest0-21swapper/022:20:240
1571268994545,0cyclictest1588167-21kworker/3:120:12:593
1571268994545,0cyclictest0-21swapper/323:21:593
1571268994545,0cyclictest0-21swapper/321:51:593
1571268994545,0cyclictest0-21swapper/300:07:583
1571268994544,1cyclictest1787508-21kworker/3:000:36:593
1571268994544,1cyclictest1774629-21kworker/3:100:23:593
1571268994544,1cyclictest1752835-21kworker/3:023:56:593
1571268994544,1cyclictest0-21swapper/319:36:593
1571265994544,1cyclictest1594771-21kworker/2:020:20:002
1571258994544,1cyclictest1789797-21sensors00:30:210
1571258994544,1cyclictest1042-21snmpd22:10:100
1571268994443,1cyclictest1636865-21kworker/3:121:34:593
1571268994443,1cyclictest1609133-21kworker/3:021:06:593
1571268994443,1cyclictest0-21swapper/300:17:583
1571265994443,1cyclictest1586380-21kworker/2:119:44:522
1571260994444,0cyclictest0-21swapper/100:32:001
1571260994443,1cyclictest0-21swapper/120:48:591
1571268994343,0cyclictest0-21swapper/322:32:593
1571268994343,0cyclictest0-21swapper/300:02:583
1571265994342,1cyclictest1569053-21kworker/2:119:10:342
1571265994241,1cyclictest1586380-21kworker/2:119:54:552
1571265994240,1cyclictest1582121-21kworker/2:219:35:172
1571268994140,1cyclictest1725079-21kworker/3:023:13:593
1571265994039,1cyclictest1594771-21kworker/2:020:55:002
1571268993938,1cyclictest1609133-21kworker/3:020:48:593
1571265993938,1cyclictest1594771-21kworker/2:020:35:222
1571268993838,0cyclictest1787508-21kworker/3:000:32:003
1571265993837,1cyclictest1590590-21kworker/2:220:01:042
1571258993837,1cyclictest1631739-21sensors21:20:220
1571265993736,1cyclictest1594771-21kworker/2:021:00:382
1571265993736,1cyclictest1594771-21kworker/2:020:55:202
1571265993736,1cyclictest1594771-21kworker/2:020:46:482
1571258993736,1cyclictest1042-21snmpd23:15:220
1571265993635,1cyclictest1594771-21kworker/2:020:26:512
1571258993635,1cyclictest0-21swapper/020:55:230
1571258993635,1cyclictest0-21swapper/000:15:230
1571258993433,1cyclictest1042-21snmpd21:50:070
157125899339,24cyclictest0-21swapper/022:34:570
1571260993231,1cyclictest0-21swapper/122:55:211
1571258993030,0cyclictest0-21swapper/022:18:580
1571258992827,1cyclictest1042-21snmpd19:14:370
1571258992827,1cyclictest0-21swapper/019:50:200
1571268992726,1cyclictest1710820-21sensors22:55:213
1571260992524,1cyclictest1042-21snmpd22:50:171
157125899230,15cyclictest0-21swapper/023:57:200
1571258992118,2cyclictest2366-21gnome-shell23:47:590
1571268992019,1cyclictest0-21swapper/322:50:173
1571258991918,1cyclictest0-21swapper/021:15:230
1571260991817,1cyclictest0-21swapper/121:03:581
1571258991816,1cyclictest1783613-21ssh00:23:580
157125899180,17cyclictest1667409-21ssh22:04:270
1571258991716,1cyclictest1769011-21sensors00:05:190
157125899170,16cyclictest0-21swapper/022:09:220
157125899170,16cyclictest0-21swapper/021:55:090
157125899170,16cyclictest0-21swapper/019:48:540
1571258991615,1cyclictest1731613-21sensors23:20:200
157125899160,16cyclictest0-21swapper/022:39:290
157125899160,16cyclictest0-21swapper/000:10:230
1571258991512,1cyclictest0-21swapper/021:11:440
157125899150,7cyclictest0-21swapper/021:41:510
157125899150,15cyclictest0-21swapper/022:41:290
1571268991412,2cyclictest1042-21snmpd21:03:223
1571258991413,1cyclictest1042-21snmpd20:14:500
1571258991413,1cyclictest0-21swapper/023:30:200
1571258991413,1cyclictest0-21swapper/019:29:340
157125899140,6cyclictest0-21swapper/020:52:100
157125899140,14cyclictest0-21swapper/021:25:210
160599130,7ntpd1583450-21ntpq19:35:190
1571258991310,2cyclictest1042-21snmpd00:29:350
157126099129,2cyclictest1042-21snmpd23:07:271
157126099129,2cyclictest1042-21snmpd22:00:031
157126099123,9cyclictest0-21swapper/122:35:141
157126899119,1cyclictest1042-21snmpd22:36:053
157125899119,2cyclictest1706185-21cat22:50:150
1571258991110,1cyclictest0-21swapper/023:29:130
157125899110,1cyclictest0-21swapper/022:55:140
157126099109,1cyclictest1042-21snmpd23:03:021
157125899108,2cyclictest1042-21snmpd20:17:360
15712689986,2cyclictest1042-21snmpd23:08:183
15712689975,2cyclictest1042-21snmpd23:04:353
15712689960,3cyclictest1665385-21users22:00:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional