Владимир Кошелев «Автоматический поиск ошибок»

Àâòîìàòè÷åñêèé ïîèñê îøèáîê

Âëàäèìèð Êîøåëåâ

Èíñòèòóò ñèñòåìíîãî ïðîãðàììèðîâàíèÿ ÐÀÍ

[email protected]

21 ôåâðàëÿ 2017 ã.

Âëàäèìèð Êîøåëåâ (ÈÑÏ ÐÀÍ) Àâòîìàòè÷åñêèé ïîèñê îøèáîê 21 ôåâðàëÿ 2017 ã. 1 / 29

Ïëàí

1 Ââåäåíèå

2 Âåðèôèêàöèÿ

3 Roslyn: èñïîëüçóåì íà ïðàêòèêå

4 Ñòàòè÷åñêèé àíàëèç

5 Äèíàìè÷åñêèé àíàëèç


Ââåäåíèå


Îá ÈÑÏ ÐÀÍ

×åì ìû çàíèìàåìñÿ:

Àíàëèç èñõîäíîãî êîäà ïðîãðàìì äëÿ ïîèñêà îøèáîê:

C/C++JavaC#

Àíàëèç áèíàðíîãî êîäà

Ðàçðàáîòêà GCC

Ðàçðàáîòêà QEMU

...


Îá ÈÑÏ ÐÀÍ



C/C++JavaC#




...


Îá ÈÑÏ ÐÀÍ



C/C++JavaC#




...


Îá ÈÑÏ ÐÀÍ



C/C++JavaC#




...


Òåîðåìà Ðàéñà

Â ÷åì çàêëþ÷àåòñÿ îñíîâíàÿ ñëîæíîñòü àíàëèçà ïðîãðàìì?


Òåîðåìà Ðàéñà

Â ÷åì çàêëþ÷àåòñÿ îñíîâíàÿ ñëîæíîñòü àíàëèçà ïðîãðàìì?


Ïîñòàíîâêè çàäà÷è ïðè ïîèñêå áàãîâ

Íàõîäèì âñå áàãè è èìååì ëîæíûå ñðàáàòûâàíèÿ:

Âåðèôèêàöèÿ

Íàõîäèì íå âñå áàãè è èìååì ëîæíûå ñðàáàòûâàíèÿ:

Ñòàòè÷åñêèé àíàëèç

Íàõîäèì òîëüêî áàãè, íî íàéäåì ÿâíî íå âñå:

Äèíàìè÷åñêèé àíàëèçÑìåøàííûé àíàëèç




















Âåðèôèêàöèÿ: ïîèñê íåèíèöèàëèçèðîâàííûõ ïåðåìåííûõ

public string Foo(string a, string b) {

string min;

int cmpResult = a.CompareTo(b);

if (cmpResult < 0)

min = a;

if (cmpResult >= 0)

min = b;

return min;

}


Âåðèôèêàöèÿ: ïîèñê íåèíèöèàëèçèðîâàííûõ ïåðåìåííûõ

public string Foo(string a, string b) {

string min;

int cmpResult = a.CompareTo(b);

if (cmpResult < 0) // False

min = a;

if (cmpResult >= 0) // False

min = b;

return min;

}


"Âåðèôèêàöèÿ"â CodeContracts


Ïðèìåð êîíòðàêòîâ

public string Greet(string [] args)

{

Contract.Requires(args != null);

Contract.Requires(args.Length > 0);

Contract.Requires(args [0] != null);

Contract.Ensures(Contract.Result <string >().Length

> 5);

Console.WriteLine("Hello , {0}!", args [0]);

return "abacaba" + args [0];

}


Roslyn: èñïîëüçóåì íà ïðàêòèêå


Ïàðó ñëîâ î Roslyn


Ïðàêòè÷åñêîå ïðèìåíåíèå Roslyn: áîðåìñÿ ñ boilerplate

Entitas - The Entity Component System Framework for C# and Unity

Çàäà÷à: àâòîìàòè÷åñêè ãåíåðèðîâàòü boilerplate êîä äëÿ ðàáîòû ñêîìïîíåíòàìè.

public class PositionComponent : IComponent

{

public float X;

public float Y;

}

public void AddPosition(float newX , float newY) {

var component =

CreateComponent <PositionComponent >

(BattleComponentsLookup.Position);

component.X = newX;

component.Y = newY;

AddComponent(BattleComponentsLookup.Position ,

component);

}






{

public float X;

public float Y;

}


var component =



component.X = newX;

component.Y = newY;


component);

}






{

public float X;

public float Y;

}


var component =



component.X = newX;

component.Y = newY;


component);

}Âëàäèìèð Êîøåëåâ (ÈÑÏ ÐÀÍ) Àâòîìàòè÷åñêèé ïîèñê îøèáîê 21 ôåâðàëÿ 2017 ã. 14 / 29

Ãåíåðàöèÿ ÷åðåç Re�ection

var types = Assembly

.GetAssembly(typeof(MainClass))

.GetTypes ();

foreach (var type in types)

{

Process(type);

}

Ãëàâíàÿ ïðîáëåìà: ãåíåðàöèÿ ðàáîòàåò òîëüêî åñëè ïðîåêò êîìïèëèðóåòñÿ.

Åñëè âû õîòèòå ðåôàêòîðèòü, íóæíî èñïðàâëÿòü âñå îøèáêè âñãåíåðèðîâàííîì êîäå.


Ãåíåðàöèÿ ÷åðåç Re�ection

var types = Assembly

.GetAssembly(typeof(MainClass))

.GetTypes ();


{

Process(type);

}

Ãëàâíàÿ ïðîáëåìà: ãåíåðàöèÿ ðàáîòàåò òîëüêî åñëè ïðîåêò êîìïèëèðóåòñÿ.

Åñëè âû õîòèòå ðåôàêòîðèòü, íóæíî èñïðàâëÿòü âñå îøèáêè âñãåíåðèðîâàííîì êîäå.


Ãåíåðàöèÿ ÷åðåç Roslyn

using (var workspace = MSBuildWorkspace.Create ())

{

var solution =

workspace.OpenSolutionAsync(path).Result;

foreach (var project in solution.Projects){

var compilation =

project.GetCompilationAsync ().Result;

var allTypes =

compilation.GetSymbolsWithName(x => true ,

SymbolFilter.Type).OfType <ITypeSymbol >();


Process(type)

}

}


Èñêëþ÷åíèå íà Mac/Mono

Unhandled Exception:System.Reflection.ReflectionTypeLoadException: The classes in the module cannot be

loaded.at (wrapper managed -to-native) System.Reflection.Assembly:GetTypes

(System.Reflection.Assembly ,bool)at System.Reflection.Assembly.GetTypes () [0 x00000] in

<8f2c484307284b51944a1a13a14c0266 >:0at System.Reflection.Assembly+<>c__Iterator0.MoveNext () [0 x00021] in

<8f2c484307284b51944a1a13a14c0266 >:0at System.Linq.Enumerable+WhereSelectEnumerableIterator `2[ TSource ,TResult ]. MoveNext ()

[0 x00078] in <63992662 b765477a898ef49cdcc99ee2 >:0at System.Linq.Enumerable+<SelectManyIterator >c__Iterator2 `2[ TSource ,TResult ]. MoveNext

() [0 x000bc] in <63992662 b765477a898ef49cdcc99ee2 >:0at System.Composition.TypedParts.TypedPartExportDescriptorProvider ..ctor

(System.Collections.Generic.IEnumerable `1[T] types ,System.Composition.Convention.AttributedModelProvider attributeContext) [0 x00049]in <c091afde214c4b8e8efbbeb9d44062d4 >:0

at System.Composition.Hosting.ContainerConfiguration.CreateContainer () [0 x00042] in<c091afde214c4b8e8efbbeb9d44062d4 >:0

at Microsoft.CodeAnalysis.Host.Mef.MefHostServices.Create(System.Collections.Generic.IEnumerable `1[T] assemblies) [0 x00019] in<947408 acdcbc4eba93cdb6a19d92fcd1 >:0

at Microsoft.CodeAnalysis.Host.Mef.DesktopMefHostServices.get_DefaultServices ()[0 x00011] in <2ba3a08d4fe0467c8c54c8bc37c61987 >:0

at Microsoft.CodeAnalysis.MSBuild.MSBuildWorkspace.Create(System.Collections.Generic.IDictionary `2[TKey ,TValue] properties) [0 x00000] in<2ba3a08d4fe0467c8c54c8bc37c61987 >:0

at Microsoft.CodeAnalysis.MSBuild.MSBuildWorkspace.Create () [0 x00000] in<2ba3a08d4fe0467c8c54c8bc37c61987 >:0

...




Çà÷åì ðàçðàáîò÷èêàì íóæåí ñòàòè÷åñêèé àíàëèç

Ñòàòè÷åñêèé àíàëèç èñïîëüçóåòñÿ êàê äëÿ ïîèñêà îøèáîê äîòåñòèðîâàíèÿ, òàê è äëÿ ïîèñêà îøèáîê, ïðîïóùåííûõ ïðèòåñòèðîâàíèè

×åì áîëüøå ðàçìåð êîìàíäû, òåì ýôôåêòèâíåå ðàáîòàåòñòàòè÷åñêèé àíàëèç

Ïðèìåíåíèå ñëîæíîãî ñòàòè÷åñêîãî àíàëèçà ïðåäïîëàãàåòâûñîêóþ öåíó îøèáêè

Ñòàòè÷åñêèé àíàëèç õîðîøî ñî÷åòàåòñÿ ñ CodeReview




















Òðåáîâàíèÿ ê ñòàòè÷åñêèì àíàëèçàòîðàì

Âðåìÿ ðàáîòû

Ñîîòíîøåíèå "âûäàíî ïðåäóïðåæäåíèé/âíåñåíî èñïðàâëåíèé"

Ïîääåðæèâàåìûå êëàññû îøèáîê, âêëþ÷àÿ ïîäêëàññû

Ïîíÿòíîñòü ñîîáùåíèé îá îøèáêàõ

Èíòåãðàöèÿ ñ CI






























Èíñòðóìåíòû ñòàòè÷åñêîãî àíàëèçà

Coverity

SharpChecker (íàø èíñòðóìåíò)

SonarLint

ReSharper

PVS-Studio


Coverity

Äå ôàêòî ñòàíäàðò êà÷åñòâà äëÿ èíñòðóìåíòîâ ñòàòè÷åñêîãîàíàëèçà

Ïðîäàåòñÿ òîëüêî çà áîëüøèå äåíüãè

Áåñïëàòåí äëÿ OpenSource íà https://scan.coverity.com

Âñå âèäû àíàëèçà: AST, âíóòðèïðîöåäðóíûé, ìåæïðîöåäóðûíé


SharpChecker

Ñòàòè÷åñêèé àíàëèç íà îñíîâå Roslyn, ðàçðàáîòàííûé â ÈÑÏ ÐÀÍ.

Öåëü ïðîåêòà: ðàçðàáîòàòü èíñòðóìåíò, ñîîòâåòñòâóþùèé óðîâíþëó÷øèõ ñîâðåìåííûõ ñòàòè÷åñêèõ àíàëèçàòîðîâ.

Âñå âèäû àíàëèçà: AST, âíóòðèïðîöåäðóíûé, ìåæïðîöåäóðûíé.

http://sharpchecker.ispras.ru


SonarLint for VisualStudio

Áåñïëàòíàÿ êîëëåêöèÿ àíàëèçàòîðîâ äëÿ Roslyn

Èíòåãðàöèÿ ñ SonarQube

Èíòåãðàöèÿ ñ ñáîðêîé msbuild

Áîëåå 100 AST àíàëèçàòîðîâ

Èíòåãðàöèÿ ñ Visual Studio


Ñðàâíåíèå ReSharper è PVS-Studio

ReSharper PVS-Studio

Êîëè÷åñòâî ñòàòåé íàõàðáðàõàáðå çà ôåâðàëü

0 8

Íàëè÷èå AST-äåòåêòîðîâ Äà Äà

Íàëè÷èå âíóòðèïðîöåäóðíîãîàíàëèçà ïîòîêîâ äàííûõ

Äà Íåò

Àíàëèç âî âðåìÿ ðàçðàáîòêè Äà Íåò

Èíòåãðàöèÿ ñ CI Äà Äà

Õîðîøàÿ äîêóìåíòàöèÿ Íåò Äà





0 8



Äà Íåò








0 8



Äà Íåò








0 8



Äà Íåò








0 8



Äà Íåò








0 8



Äà Íåò








0 8



Äà Íåò





Äèíàìè÷åñêèé àíàëèç


PEX / IntelliTest

http://www.pexforfun.com/


Èäåÿ ðàáîòû IntelliTest

Àëãîðèòì ðàáîòû:

çàïóñòèì ìåòîä ñ êàêèìè-íèáóäü ïàðàìåòðàìè;

ïîñòðîèì ôîðìóëó, êîòîðàÿ îïèñûâàåò åãî âûïîëíåíèå;

ðåøèì çàäà÷ó: êàêèìè äîëæíû áûòü ïàðàìåòðû, ÷òîáûâûïîëíåíèå ïðîøëî ïî äðóãîé âåòêå è óâåëè÷èëî ïîêðûòèå;

çàïóñòèì ñ íîâûìè äàííûìè.























Ñïàñèáî çà âíèìàíèå!

Âëàäèìèð Êîøåëåâ[email protected]

Ññûëêè:SharpChecker: http://sharpchecker.ispras.ru

Coverity: https://scan.coverity.comSonarLint : http://www.sonarlint.org/visualstudio/


Technology

Владимир Кошелев «Автоматический поиск ошибок»