You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-24 - 16:40

x86 Intel Xeon E5-2650Lv2 @1700 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #6, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack6slot0.osadl.org (updated Mon Mar 20, 2023 02:52:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
501999271267,2cyclictest0-21swapper/519:45:2635
501999271267,2cyclictest0-21swapper/519:45:2535
5050992080,67cyclictest0-21swapper/2923:10:2422
5050992080,67cyclictest0-21swapper/2923:10:2322
5050992031,118cyclictest0-21swapper/2923:05:2722
5050992031,118cyclictest0-21swapper/2923:05:2722
5050992000,1cyclictest0-21swapper/2922:02:2922
5050992000,1cyclictest0-21swapper/2922:02:2822
5050991930,2cyclictest0-21swapper/2921:25:3322
5050991930,2cyclictest0-21swapper/2921:25:3222
5050991930,2cyclictest0-21swapper/2921:25:3222
5055991921,71cyclictest0-21swapper/3322:15:1627
5055991921,71cyclictest0-21swapper/3322:15:1527
5055991921,71cyclictest0-21swapper/3322:15:1527
50559919143,50cyclictest0-21swapper/3321:39:4427
50559919143,50cyclictest0-21swapper/3321:39:4427
5061991900,2cyclictest0-21swapper/3600:20:0330
5061991900,2cyclictest0-21swapper/3600:20:0330
5050991901,172cyclictest0-21swapper/2900:16:5922
5050991901,172cyclictest0-21swapper/2900:16:5922
50559918942,108cyclictest12862-21qemu-system-x8622:47:0727
50559918942,108cyclictest12862-21qemu-system-x8622:47:0627
50559918845,133cyclictest0-21swapper/3323:45:2827
50559918845,133cyclictest0-21swapper/3323:45:2727
5050991861,182cyclictest0-21swapper/2923:45:0122
5050991861,182cyclictest0-21swapper/2923:45:0122
5050991850,102cyclictest0-21swapper/2922:50:2222
5050991850,102cyclictest0-21swapper/2922:50:2122
50559918447,85cyclictest0-21swapper/3323:50:4027
50559918447,85cyclictest0-21swapper/3323:50:3927
50559918440,55cyclictest0-21swapper/3322:30:3827
50559918440,55cyclictest0-21swapper/3322:30:3827
5050991840,121cyclictest0-21swapper/2922:14:5222
5050991840,121cyclictest0-21swapper/2922:14:5222
50559918353,53cyclictest0-21swapper/3300:26:0127
50559918353,53cyclictest0-21swapper/3300:26:0027
50559918347,76cyclictest0-21swapper/3322:06:4027
50559918347,76cyclictest0-21swapper/3322:06:4027
50509918383,62cyclictest12515-21run-parts23:55:2622
50509918383,62cyclictest12515-21run-parts23:55:2622
50389918335,143cyclictest0-21swapper/1922:15:1611
50389918335,143cyclictest0-21swapper/1922:15:1611
50389918335,143cyclictest0-21swapper/1922:15:1511
503499182176,3cyclictest37862-21qemu-system-x8619:30:148
503499182176,3cyclictest37862-21qemu-system-x8619:30:138
50359918139,136cyclictest25031-21CPU9
50359918139,136cyclictest25031-21CPU9
5061991800,4cyclictest10897-21CPU30
5061991800,4cyclictest10897-21CPU30
5050991801,98cyclictest0-21swapper/2922:16:5322
5050991801,98cyclictest0-21swapper/2922:16:5322
5050991801,98cyclictest0-21swapper/2922:16:5322
5019991801,6cyclictest0-21swapper/522:50:2735
5019991801,6cyclictest0-21swapper/522:50:2735
5062991791,7cyclictest0-21swapper/3700:15:3431
5062991791,7cyclictest0-21swapper/3700:15:3431
50559917945,90cyclictest0-21swapper/3321:58:4827
50559917945,90cyclictest0-21swapper/3321:58:4827
5050991791,138cyclictest0-21swapper/2922:36:2622
5050991791,138cyclictest0-21swapper/2922:36:2622
5050991791,138cyclictest0-21swapper/2922:36:2522
50559917848,91cyclictest0-21swapper/3321:48:5327
50559917848,91cyclictest0-21swapper/3321:48:5227
5061991770,174cyclictest909-21sshd21:14:2230
5061991770,174cyclictest909-21sshd21:14:2230
50559917743,77cyclictest0-21swapper/3323:02:0727
50559917743,77cyclictest0-21swapper/3323:02:0627
5046991771,172cyclictest30258-21sshd21:43:3618
5046991771,172cyclictest30258-21sshd21:43:3618
5046991771,172cyclictest30258-21sshd21:43:3618
50389917764,74cyclictest0-21swapper/1921:15:0511
50389917764,74cyclictest0-21swapper/1921:15:0511
50389917730,141cyclictest26093-21sshd22:25:2111
50389917730,141cyclictest26093-21sshd22:25:2111
442221770,7sleep23504299cyclictest00:28:2916
442221770,7sleep23504299cyclictest00:28:2816
63521760,7sleep1501399cyclictest22:35:271
63521760,7sleep1501399cyclictest22:35:261
63521760,7sleep1501399cyclictest22:35:261
5061991760,173cyclictest10645-21sshd00:28:5830
5061991760,173cyclictest10645-21sshd00:28:5730
50559917640,83cyclictest0-21swapper/3300:00:5427
50559917640,83cyclictest0-21swapper/3300:00:5427
50559917640,71cyclictest12939-21CPU27
50559917640,71cyclictest12939-21CPU27
5050991761,171cyclictest0-21swapper/2922:28:0922
5050991761,171cyclictest0-21swapper/2922:28:0822
50559917541,109cyclictest0-21swapper/3322:57:2427
50559917541,109cyclictest0-21swapper/3322:57:2327
50559917452,80cyclictest0-21swapper/3323:59:5527
50559917452,80cyclictest0-21swapper/3323:59:5427
50559917438,132cyclictest0-21swapper/3300:05:3127
50559917438,132cyclictest0-21swapper/3300:05:3027
50559917431,58cyclictest0-21swapper/3322:20:1927
50559917431,58cyclictest0-21swapper/3322:20:1827
50559917430,129cyclictest0-21swapper/3300:17:1527
50559917430,129cyclictest0-21swapper/3300:17:1427
50389917436,135cyclictest0-21swapper/1922:44:0111
50389917436,135cyclictest0-21swapper/1922:44:0111
5061991731,3cyclictest0-21swapper/3622:35:5030
5061991731,3cyclictest0-21swapper/3622:35:4930
5061991731,3cyclictest0-21swapper/3622:35:4930
5061991731,3cyclictest0-21swapper/3622:30:2530
5061991731,3cyclictest0-21swapper/3622:30:2430
50559917373,65cyclictest0-21swapper/3322:54:0927
50559917373,65cyclictest0-21swapper/3322:54:0827
50559917355,80cyclictest0-21swapper/3300:20:4227
50559917355,80cyclictest0-21swapper/3300:20:4127
50559917346,84cyclictest0-21swapper/3323:42:4627
50559917346,84cyclictest0-21swapper/3323:42:4527
5050991731,162cyclictest0-21swapper/2920:05:2422
5050991731,162cyclictest0-21swapper/2920:05:2422
50369917332,133cyclictest0-21swapper/1823:00:1710
50369917332,133cyclictest0-21swapper/1823:00:1610
50359917380,91cyclictest0-21swapper/1721:13:409
50359917380,91cyclictest0-21swapper/1721:13:409
5061991724,163cyclictest14277-21qemu-system-x8623:00:0230
5061991724,163cyclictest14277-21qemu-system-x8623:00:0230
5061991721,168cyclictest7731-21sshd21:47:5330
5061991721,168cyclictest7731-21sshd21:47:5230
5039991721,167cyclictest1-21systemd22:55:3513
5039991721,167cyclictest1-21systemd22:55:3413
5061991711,2cyclictest0-21swapper/3623:45:4230
5061991711,2cyclictest0-21swapper/3623:45:4130
5061991710,165cyclictest16375-21sshd21:15:2230
5061991710,165cyclictest16375-21sshd21:15:2130
50559917148,91cyclictest0-21swapper/3300:34:4727
50559917148,91cyclictest0-21swapper/3300:34:4627
50559917147,74cyclictest0-21swapper/3323:24:5327
50559917147,74cyclictest0-21swapper/3323:24:5227
50559917147,74cyclictest0-21swapper/3323:24:5227
50559917139,80cyclictest1992-21nfsd22:00:3427
50559917139,80cyclictest1992-21nfsd22:00:3327
5050991715,139cyclictest0-21swapper/2923:24:5522
5050991715,139cyclictest0-21swapper/2923:24:5522
5050991715,139cyclictest0-21swapper/2923:24:5422
5050991711,165cyclictest0-21swapper/2919:25:2722
5050991711,165cyclictest0-21swapper/2919:25:2622
5050991710,165cyclictest21725-21sshd21:40:0322
5050991710,165cyclictest21725-21sshd21:40:0222
50389917139,124cyclictest0-21swapper/1922:15:0111
50389917139,124cyclictest0-21swapper/1922:15:0011
4038021710,4sleep35505899cyclictest23:48:2729
4038021710,4sleep35505899cyclictest23:48:2629
50559917043,80cyclictest0-21swapper/3323:32:2927
50559917043,80cyclictest0-21swapper/3323:32:2927
50559917043,80cyclictest0-21swapper/3323:32:2827
5050991701,143cyclictest0-21swapper/2922:45:4922
5050991701,143cyclictest0-21swapper/2922:45:4822
50389917026,140cyclictest0-21swapper/1922:52:0911
50389917026,140cyclictest0-21swapper/1922:52:0811
2439621700,4sleep29505099cyclictest23:50:2122
2439621700,4sleep29505099cyclictest23:50:2022
50559916944,88cyclictest0-21swapper/3300:38:5327
50559916944,88cyclictest0-21swapper/3300:38:5227
50559916939,99cyclictest0-21swapper/3323:07:1127
50559916939,99cyclictest0-21swapper/3323:07:1027
50559916932,112cyclictest0-21swapper/3321:21:0727
50559916932,112cyclictest0-21swapper/3321:21:0627
5050991691,164cyclictest1-21systemd23:17:3022
5050991691,164cyclictest1-21systemd23:17:2922
5050991690,4cyclictest18483-21qemu-system-x8623:45:3322
5050991690,4cyclictest18483-21qemu-system-x8623:45:3222
5050991690,1cyclictest0-21swapper/2919:10:2722
5050991690,1cyclictest0-21swapper/2919:10:2722
50389916941,123cyclictest0-21swapper/1921:20:2311
50389916941,123cyclictest0-21swapper/1921:20:2211
5061991681,134cyclictest26410-21uname22:16:0530
5061991681,134cyclictest26410-21uname22:16:0530
5061991681,134cyclictest26410-21uname22:16:0530
50559916849,104cyclictest0-21swapper/3322:14:1327
50559916849,104cyclictest0-21swapper/3322:14:1227
50559916848,47cyclictest0-21swapper/3319:27:4227
50559916848,47cyclictest0-21swapper/3319:27:4127
50559916847,75cyclictest0-21swapper/3319:57:2727
50559916847,75cyclictest0-21swapper/3319:57:2627
50559916846,52cyclictest0-21swapper/3321:29:0427
50559916846,52cyclictest0-21swapper/3321:29:0327
50559916846,52cyclictest0-21swapper/3321:29:0327
5050991681,2cyclictest0-21swapper/2900:15:0622
50389916815,148cyclictest0-21swapper/1923:00:2911
50389916815,148cyclictest0-21swapper/1923:00:2811
5035991686,155cyclictest0-21swapper/1723:00:269
5035991686,155cyclictest0-21swapper/1723:00:259
5025991681,2cyclictest0-21swapper/1023:45:022
5025991681,2cyclictest0-21swapper/1023:45:012
505199167163,2cyclictest0-21swapper/3000:10:5424
505199167163,2cyclictest0-21swapper/3000:10:5324
505199167163,2cyclictest0-21swapper/3000:10:5324
5050991671,163cyclictest21438-21sshd22:30:5122
5050991671,163cyclictest21438-21sshd22:30:5022
50389916738,122cyclictest0-21swapper/1921:50:3211
50389916738,122cyclictest0-21swapper/1921:50:3111
50389916733,131cyclictest0-21swapper/1920:41:2711
5035991672,160cyclictest0-21swapper/1722:15:179
5035991672,160cyclictest0-21swapper/1722:15:179
5035991672,160cyclictest0-21swapper/1722:15:169
503399167161,3cyclictest25030-21CPU7
503399167161,3cyclictest25030-21CPU7
503199167155,6cyclictest12943-21CPU5
503199167155,6cyclictest12943-21CPU5
50259916721,140cyclictest1376-21in:imuxsock22:30:272
50259916721,140cyclictest1376-21in:imuxsock22:30:262
2534421670,2sleep310-21swapper/3121:34:1625
2534421670,2sleep310-21swapper/3121:34:1625
2534421670,2sleep310-21swapper/3121:34:1525
1031521670,4sleep18503699cyclictest00:25:4310
1031521670,4sleep18503699cyclictest00:25:4310
5061991661,3cyclictest0-21swapper/3623:25:2230
5061991661,3cyclictest0-21swapper/3623:25:2130
5061991661,162cyclictest7904-21sshd22:54:1730
5061991661,162cyclictest7904-21sshd22:54:1630
5061991661,161cyclictest7620-21sshd23:06:1230
5061991661,161cyclictest7620-21sshd23:06:1130
50559916642,120cyclictest25030-21CPU27
50559916642,120cyclictest25030-21CPU27
50559916639,34cyclictest0-21swapper/3321:50:3427
50559916639,34cyclictest0-21swapper/3321:50:3327
50389916637,123cyclictest0-21swapper/1922:22:5611
50389916637,123cyclictest0-21swapper/1922:22:5611
50359916617,145cyclictest0-21swapper/1719:55:239
50359916617,145cyclictest0-21swapper/1719:55:239
3813721660,4sleep10502599cyclictest21:29:132
3813721660,4sleep10502599cyclictest21:29:132
3813721660,4sleep10502599cyclictest21:29:122
5061991651,158cyclictest15174-21sshd00:14:0430
5061991651,158cyclictest15174-21sshd00:14:0330
5061991651,158cyclictest15174-21sshd00:14:0330
5061991650,2cyclictest0-21swapper/3623:00:1730
5061991650,2cyclictest0-21swapper/3623:00:1630
5061991650,162cyclictest6068-21sshd22:02:4430
5061991650,162cyclictest6068-21sshd22:02:4430
5061991650,161cyclictest18890-21sshd00:01:5430
5061991650,161cyclictest18890-21sshd00:01:5330
5050991650,141cyclictest0-21swapper/2900:00:4922
5050991650,141cyclictest0-21swapper/2900:00:4922
50369916549,78cyclictest0-21swapper/1821:20:1910
50369916549,78cyclictest0-21swapper/1821:20:1810
5061991640,160cyclictest40574-21sshd23:33:1430
5061991640,160cyclictest40574-21sshd23:33:1330
5061991640,160cyclictest40574-21sshd23:33:1330
5061991640,160cyclictest28850-21sshd22:28:3530
5061991640,160cyclictest28850-21sshd22:28:3430
505699164102,55cyclictest0-21swapper/3421:23:3728
505699164102,55cyclictest0-21swapper/3421:23:3628
50559916441,80cyclictest0-21swapper/3322:36:0527
50559916441,80cyclictest0-21swapper/3322:36:0527
50559916441,80cyclictest0-21swapper/3322:36:0427
5050991641,132cyclictest0-21swapper/2900:31:2122
5050991641,132cyclictest0-21swapper/2900:31:2022
5050991641,118cyclictest0-21swapper/2921:40:2422
5050991641,118cyclictest0-21swapper/2921:40:2322
5050991641,118cyclictest0-21swapper/2921:40:2322
5050991640,1cyclictest0-21swapper/2900:12:4322
5050991640,1cyclictest0-21swapper/2900:12:4322
5050991640,135cyclictest0-21swapper/2923:36:1422
5050991640,135cyclictest0-21swapper/2923:36:1322
5050991640,127cyclictest28968-21sshd23:01:4622
5050991640,127cyclictest28968-21sshd23:01:4522
50369916422,55cyclictest0-21swapper/1822:25:2410
50369916422,55cyclictest0-21swapper/1822:25:2410
502999164101,53cyclictest0-21swapper/1222:30:184
502999164101,53cyclictest0-21swapper/1222:30:174
5025991641,7cyclictest0-21swapper/1000:37:242
5025991641,7cyclictest0-21swapper/1000:37:232
351921640,4sleep32505499cyclictest21:59:4626
351921640,4sleep32505499cyclictest21:59:4626
5061991631,158cyclictest4862-21sshd00:22:2230
5061991631,158cyclictest4862-21sshd00:22:2230
5061991630,159cyclictest40620-21sshd23:54:4330
5061991630,159cyclictest40620-21sshd23:54:4230
5061991630,159cyclictest20058-21sshd00:32:3730
5061991630,159cyclictest20058-21sshd00:32:3630
50559916352,82cyclictest0-21swapper/3323:29:1027
50559916352,82cyclictest0-21swapper/3323:29:0927
5050991631,158cyclictest0-21swapper/2921:49:4822
5050991631,158cyclictest0-21swapper/2921:49:4722
5050991630,149cyclictest0-21swapper/2922:22:3222
5050991630,149cyclictest0-21swapper/2922:22:3122
5045991638,108cyclictest0-21swapper/2423:42:3617
5045991638,108cyclictest0-21swapper/2423:42:3517
50369916321,138cyclictest0-21swapper/1822:15:2310
50369916321,138cyclictest0-21swapper/1822:15:2210
50369916321,138cyclictest0-21swapper/1822:15:2210
50359916315,139cyclictest0-21swapper/1722:41:199
50359916315,139cyclictest0-21swapper/1722:41:189
5061991620,159cyclictest34837-21sshd21:43:5830
5061991620,159cyclictest34837-21sshd21:43:5830
5061991620,159cyclictest34837-21sshd21:43:5730
5055991627,92cyclictest0-21swapper/3323:18:2927
5055991627,92cyclictest0-21swapper/3323:18:2827
50559916243,114cyclictest0-21swapper/3300:11:0127
50559916243,114cyclictest0-21swapper/3300:11:0027
50559916243,114cyclictest0-21swapper/3300:11:0027
50559916237,120cyclictest0-21swapper/3322:41:0227
50559916237,120cyclictest0-21swapper/3322:41:0227
5050991625,123cyclictest37906-21CPU22
5050991625,123cyclictest37906-21CPU22
50389916227,54cyclictest0-21swapper/1920:06:1611
50389916227,54cyclictest0-21swapper/1920:06:1511
503199162157,2cyclictest0-21swapper/1322:58:345
503199162157,2cyclictest0-21swapper/1322:58:335
1663321620,1sleep230-21swapper/2321:21:2416
1663321620,1sleep230-21swapper/2321:21:2316
5061991611,156cyclictest5495-21sshd22:11:3730
5061991611,156cyclictest5495-21sshd22:11:3630
50619916110,147cyclictest12944-21CPU30
50619916110,147cyclictest12944-21CPU30
50559916147,78cyclictest25027-21CPU27
50559916147,78cyclictest25027-21CPU27
50559916147,78cyclictest25027-21CPU27
50509916181,72cyclictest2996-21cstates20:55:1522
50509916181,72cyclictest2996-21cstates20:55:1422
5050991611,155cyclictest0-21swapper/2922:10:0222
5050991611,155cyclictest0-21swapper/2922:10:0222
5036991618,103cyclictest0-21swapper/1822:21:4010
5036991618,103cyclictest0-21swapper/1822:21:4010
50369916122,53cyclictest0-21swapper/1823:19:5810
50369916122,53cyclictest0-21swapper/1823:19:5710
2860721610,3sleep17503599cyclictest22:49:479
2860721610,3sleep17503599cyclictest22:49:479
2367921610,3sleep373531ktimersoftd/3721:49:0731
2367921610,3sleep373531ktimersoftd/3721:49:0631
50559916056,70cyclictest0-21swapper/3319:14:2427
50559916056,70cyclictest0-21swapper/3319:14:2327
50559916047,85cyclictest0-21swapper/3323:14:1927
50559916047,85cyclictest0-21swapper/3323:14:1827
50559916042,76cyclictest12234-21gdbus21:12:3327
50559916042,76cyclictest12234-21gdbus21:12:3227
50559916033,99cyclictest0-21swapper/3319:20:2827
5050991601,3cyclictest37862-21qemu-system-x8619:35:2222
5050991601,3cyclictest37862-21qemu-system-x8619:35:2122
5050991601,135cyclictest0-21swapper/2921:32:3022
5050991601,135cyclictest0-21swapper/2921:32:3022
5050991601,135cyclictest0-21swapper/2921:32:2922
5050991600,135cyclictest0-21swapper/2921:12:3222
5050991600,135cyclictest0-21swapper/2921:12:3222
50389916042,113cyclictest0-21swapper/1921:15:5911
50389916042,113cyclictest0-21swapper/1921:15:5811
50389916033,83cyclictest0-21swapper/1923:21:5611
50389916033,83cyclictest0-21swapper/1923:21:5611
50389916033,83cyclictest0-21swapper/1923:21:5511
503499160156,2cyclictest0-21swapper/1600:19:508
503499160156,2cyclictest0-21swapper/1600:19:498
503299160156,2cyclictest0-21swapper/1422:09:586
503299160156,2cyclictest0-21swapper/1422:09:586
5061991591,153cyclictest31094-21sshd23:20:1730
5061991591,153cyclictest31094-21sshd23:20:1630
5061991591,153cyclictest31094-21sshd23:20:1630
5061991590,156cyclictest13921-21sshd21:24:2630
5061991590,156cyclictest13921-21sshd21:24:2530
50559915941,73cyclictest0-21swapper/3321:42:4627
50559915941,73cyclictest0-21swapper/3321:42:4627
50559915941,73cyclictest0-21swapper/3321:42:4527
50559915935,111cyclictest0-21swapper/3321:00:2927
50559915935,111cyclictest0-21swapper/3321:00:2827
5050991591,4cyclictest25034-21CPU22
5050991591,131cyclictest0-21swapper/2900:08:5622
5050991591,131cyclictest0-21swapper/2900:08:5522
5046991590,12cyclictest0-21swapper/2522:45:1718
5046991590,12cyclictest0-21swapper/2522:45:1618
50459915920,129cyclictest3047-21sshd21:20:2717
50459915920,129cyclictest3047-21sshd21:20:2617
50459915913,75cyclictest0-21swapper/2422:45:1617
50459915913,75cyclictest0-21swapper/2422:45:1617
5039991591,154cyclictest0-21swapper/2022:29:3313
5039991591,154cyclictest0-21swapper/2022:29:3213
5039991591,131cyclictest0-21swapper/2022:44:3013
5039991591,131cyclictest0-21swapper/2022:44:2913
50389915930,124cyclictest0-21swapper/1922:33:1311
50389915930,124cyclictest0-21swapper/1922:33:1211
50299915999,56cyclictest0-21swapper/1223:40:594
50299915999,56cyclictest0-21swapper/1223:40:594
5062991581,12cyclictest0-21swapper/3722:50:1831
5062991581,12cyclictest0-21swapper/3722:50:1731
5061991587,142cyclictest0-21swapper/3623:56:5830
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional